Oct 23 19:55:06 user nova-compute[74429]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74429) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 19:55:06 user nova-compute[74429]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74429) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 19:55:06 user nova-compute[74429]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74429) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 19:55:06 user nova-compute[74429]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 23 19:55:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:55:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:55:06 user nova-compute[74429]: INFO nova.virt.driver [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 23 19:55:06 user nova-compute[74429]: INFO nova.compute.provider_config [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Acquiring lock "singleton_lock" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Acquired lock "singleton_lock" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Releasing lock "singleton_lock" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Full set of CONF: {{(pid=74429) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ******************************************************************************** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Configuration options gathered from: {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ================================================================================ {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] allow_resize_to_same_host      = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] arq_binding_timeout            = 300 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] backdoor_port                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] backdoor_socket                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] block_device_allocate_retries  = 300 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] block_device_allocate_retries_interval = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cert                           = self.pem {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute_monitors               = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] config_dir                     = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] config_drive_format            = iso9660 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] config_source                  = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] console_host                   = user {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] control_exchange               = nova {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cpu_allocation_ratio           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] daemon                         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] debug                          = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] default_access_ip_network_name = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] default_availability_zone      = nova {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] default_ephemeral_format       = ext4 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] default_green_pool_size        = 1000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] default_schedule_zone          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] disk_allocation_ratio          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] enable_new_services            = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] enabled_apis                   = ['osapi_compute'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] enabled_ssl_apis               = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] flat_injected                  = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] force_config_drive             = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] force_raw_images               = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] graceful_shutdown_timeout      = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] heal_instance_info_cache_interval = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] host                           = user {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_build_timeout         = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_delete_interval       = 300 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_format                = [instance: %(uuid)s]  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_name_template         = instance-%08x {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_usage_audit           = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_usage_audit_period    = month {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] internal_service_availability_zone = internal {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] key                            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] live_migration_retry_count     = 30 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_config_append              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_dir                        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_file                       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_options                    = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_rotate_interval            = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_rotate_interval_type       = days {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] log_rotation_type              = none {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] long_rpc_timeout               = 1800 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] max_concurrent_builds          = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] max_concurrent_live_migrations = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] max_concurrent_snapshots       = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] max_local_block_devices        = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] max_logfile_count              = 30 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] max_logfile_size_mb            = 200 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] maximum_instance_delete_attempts = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metadata_listen                = 0.0.0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metadata_listen_port           = 8775 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metadata_workers               = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] migrate_max_retries            = -1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] mkisofs_cmd                    = genisoimage {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] my_ip                          = 10.0.0.210 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] network_allocate_retries       = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] osapi_compute_listen_port      = 8774 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] osapi_compute_unique_server_name_scope =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] osapi_compute_workers          = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] password_length                = 12 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] periodic_enable                = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] periodic_fuzzy_delay           = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] pointer_model                  = ps2mouse {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] preallocate_images             = none {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] publish_errors                 = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] pybasedir                      = /opt/stack/nova {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ram_allocation_ratio           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rate_limit_burst               = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rate_limit_except_level        = CRITICAL {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rate_limit_interval            = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reboot_timeout                 = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reclaim_instance_interval      = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] record                         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reimage_timeout_per_gb         = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] report_interval                = 120 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rescue_timeout                 = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reserved_host_cpus             = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reserved_host_disk_mb          = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reserved_host_memory_mb        = 512 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] reserved_huge_pages            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] resize_confirm_window          = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] resize_fs_using_block_device   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] resume_guests_state_on_host_boot = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rpc_response_timeout           = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] run_external_periodic_tasks    = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] running_deleted_instance_action = reap {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] running_deleted_instance_poll_interval = 1800 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] running_deleted_instance_timeout = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler_instance_sync_interval = 120 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_down_time              = 720 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] servicegroup_driver            = db {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] shelved_offload_time           = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] shelved_poll_interval          = 3600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] shutdown_timeout               = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] source_is_ipv6                 = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ssl_only                       = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] state_path                     = /opt/stack/data/nova {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] sync_power_state_interval      = 600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] sync_power_state_pool_size     = 1000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] syslog_log_facility            = LOG_USER {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] tempdir                        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] timeout_nbd                    = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] transport_url                  = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] update_resources_interval      = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_cow_images                 = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_eventlog                   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_journal                    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_json                       = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_rootwrap_daemon            = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_stderr                     = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] use_syslog                     = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vcpu_pin_set                   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plugging_is_fatal          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plugging_timeout           = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] virt_mkfs                      = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] volume_usage_poll_interval     = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] watch_log_file                 = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] web                            = /usr/share/spice-html5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_concurrency.disable_process_locking = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.auth_strategy              = keystone {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.compute_link_prefix        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.dhcp_domain                = novalocal {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.enable_instance_password   = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.glance_link_prefix         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.instance_list_per_project_cells = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.list_records_by_skipping_down_cells = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.local_metadata_per_cell    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.max_limit                  = 1000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.metadata_cache_expiration  = 15 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.neutron_default_tenant_id  = default {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.use_forwarded_for          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.use_neutron_default_nets   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_dynamic_targets = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_jsonfile_path   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.backend                  = dogpile.cache.memcached {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.backend_argument         = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.config_prefix            = cache.oslo {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.dead_timeout             = 60.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.debug_cache_backend      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.enable_retry_client      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.enable_socket_keepalive  = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.enabled                  = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.expiration_time          = 600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.hashclient_retry_attempts = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_dead_retry      = 300 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_password        =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_pool_maxsize    = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_sasl_enabled    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.memcache_username        =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.proxies                  = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.retry_attempts           = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.retry_delay              = 0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.socket_keepalive_count   = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.socket_keepalive_idle    = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.socket_keepalive_interval = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.tls_allowed_ciphers      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.tls_cafile               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.tls_certfile             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.tls_enabled              = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cache.tls_keyfile              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.auth_section            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.auth_type               = password {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.cafile                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.certfile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.collect_timing          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.cross_az_attach         = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.debug                   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.endpoint_template       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.http_retries            = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.insecure                = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.keyfile                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.os_region_name          = RegionOne {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.split_loggers           = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cinder.timeout                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.cpu_dedicated_set      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.cpu_shared_set         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.image_type_exclude_list = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.max_concurrent_disk_ops = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.max_disk_devices_to_attach = -1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.resource_provider_association_refresh = 300 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.shutdown_retry_interval = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] conductor.workers              = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] console.allowed_origins        = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] console.ssl_ciphers            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] console.ssl_minimum_version    = default {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] consoleauth.token_ttl          = 600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.cafile                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.certfile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.collect_timing          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.connect_retries         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.connect_retry_delay     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.endpoint_override       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.insecure                = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.keyfile                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.max_version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.min_version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.region_name             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.service_name            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.service_type            = accelerator {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.split_loggers           = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.status_code_retries     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.timeout                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] cyborg.version                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.backend               = sqlalchemy {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.connection            = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.connection_debug      = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.connection_parameters =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.connection_recycle_time = 3600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.connection_trace      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.db_inc_retry_interval = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.db_max_retries        = 20 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.db_max_retry_interval = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.db_retry_interval     = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.max_overflow          = 50 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.max_pool_size         = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.max_retries           = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.mysql_wsrep_sync_wait = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.pool_timeout          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.retry_interval        = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.slave_connection      = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] database.sqlite_synchronous    = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.backend           = sqlalchemy {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.connection        = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.connection_debug  = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.connection_parameters =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.connection_recycle_time = 3600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.connection_trace  = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.db_inc_retry_interval = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.db_max_retries    = 20 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.db_max_retry_interval = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.db_retry_interval = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.max_overflow      = 50 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.max_pool_size     = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.max_retries       = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.pool_timeout      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.retry_interval    = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.slave_connection  = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] api_database.sqlite_synchronous = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] devices.enabled_mdev_types     = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ephemeral_storage_encryption.enabled = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.api_servers             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.cafile                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.certfile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.collect_timing          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.connect_retries         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.connect_retry_delay     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.debug                   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.default_trusted_certificate_ids = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.enable_certificate_validation = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.enable_rbd_download     = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.endpoint_override       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.insecure                = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.keyfile                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.max_version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.min_version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.num_retries             = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.rbd_ceph_conf           =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.rbd_connect_timeout     = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.rbd_pool                =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.rbd_user                =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.region_name             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.service_name            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.service_type            = image {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.split_loggers           = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.status_code_retries     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.timeout                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.verify_glance_signatures = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] glance.version                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] guestfs.debug                  = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.config_drive_cdrom      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.config_drive_inject_password = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.enable_instance_metrics_collection = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.enable_remotefx         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.instances_path_share    =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.iscsi_initiator_list    = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.limit_cpu_features      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.power_state_check_timeframe = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.use_multipath_io        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.volume_attach_retry_count = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.vswitch_name            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] mks.enabled                    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] image_cache.manager_interval   = 2400 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] image_cache.precache_concurrency = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] image_cache.remove_unused_base_images = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] image_cache.subdirectory_name  = _base {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.api_max_retries         = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.api_retry_interval      = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.auth_section            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.auth_type               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.cafile                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.certfile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.collect_timing          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.conductor_group         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.connect_retries         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.connect_retry_delay     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.endpoint_override       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.insecure                = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.keyfile                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.max_version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.min_version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.peer_list               = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.region_name             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.serial_console_state_timeout = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.service_name            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.service_type            = baremetal {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.split_loggers           = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.status_code_retries     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.timeout                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ironic.version                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] key_manager.fixed_key          = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.barbican_api_version  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.barbican_endpoint     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.barbican_endpoint_type = public {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.barbican_region_name  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.cafile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.certfile              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.collect_timing        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.insecure              = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.keyfile               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.number_of_retries     = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.retry_delay           = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.send_service_user_token = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.split_loggers         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.timeout               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.verify_ssl            = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican.verify_ssl_path       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.auth_section = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.auth_type = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.cafile   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.certfile = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.collect_timing = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.insecure = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.keyfile  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.split_loggers = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] barbican_service_user.timeout  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.approle_role_id          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.approle_secret_id        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.cafile                   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.certfile                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.collect_timing           = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.insecure                 = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.keyfile                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.kv_mountpoint            = secret {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.kv_path                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.kv_version               = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.namespace                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.root_token_id            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.split_loggers            = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.ssl_ca_crt_file          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.timeout                  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.use_ssl                  = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.auth_section          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.auth_type             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.cafile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.certfile              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.collect_timing        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.connect_retries       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.connect_retry_delay   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.endpoint_override     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.insecure              = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.keyfile               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.max_version           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.min_version           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.region_name           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.service_name          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.service_type          = identity {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.split_loggers         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.status_code_retries   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.timeout               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] keystone.version               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.connection_uri         =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_mode               = custom {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: WARNING oslo_config.cfg [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_power_governor_high = performance {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_power_governor_low = powersave {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_power_management   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.device_detach_attempts = 8 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.device_detach_timeout  = 20 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.disk_cachemodes        = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.disk_prefix            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.enabled_perf_events    = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.file_backed_memory     = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.gid_maps               = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.hw_disk_discard        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.hw_machine_type        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_rbd_glance_store_name =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_rbd_pool        = rbd {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_type            = default {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.images_volume_group    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.inject_key             = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.inject_partition       = -2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.inject_password        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.iscsi_iface            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.iser_use_multipath     = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_bandwidth = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_downtime = 500 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_inbound_addr = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_permit_post_copy = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_scheme  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_timeout_action = abort {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_tunnelled = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: WARNING oslo_config.cfg [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 23 19:55:07 user nova-compute[74429]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 23 19:55:07 user nova-compute[74429]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 23 19:55:07 user nova-compute[74429]: and ``live_migration_inbound_addr`` respectively.
Oct 23 19:55:07 user nova-compute[74429]: ).  Its value may be silently ignored in the future.
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.live_migration_with_native_tls = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.max_queues             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.nfs_mount_options      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.num_memory_encrypted_guests = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.num_pcie_ports         = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.pmem_namespaces        = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.quobyte_client_cfg     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rbd_secret_uuid        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rbd_user               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.remote_filesystem_transport = ssh {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rescue_image_id        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rescue_kernel_id       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rescue_ramdisk_id      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.rx_queue_size          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.smbfs_mount_options    =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.snapshot_compression   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.snapshot_image_format  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.sparse_logical_volumes = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.swtpm_enabled          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.swtpm_group            = tss {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.swtpm_user             = tss {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.sysinfo_serial         = unique {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.tb_cache_size          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.tx_queue_size          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.uid_maps               = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.use_virtio_for_bridges = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.virt_type              = kvm {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.volume_clear           = zero {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.volume_clear_size      = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.volume_use_multipath   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_cache_path   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.vzstorage_mount_user   = stack {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.auth_section           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.auth_type              = password {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.cafile                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.certfile               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.collect_timing         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.connect_retries        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.connect_retry_delay    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.default_floating_pool  = public {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.endpoint_override      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.extension_sync_interval = 600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.http_retries           = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.insecure               = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.keyfile                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.max_version            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.min_version            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.ovs_bridge             = br-int {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.physnets               = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.region_name            = RegionOne {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.service_metadata_proxy = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.service_name           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.service_type           = network {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.split_loggers          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.status_code_retries    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.timeout                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] neutron.version                = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] notifications.bdms_in_notifications = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] notifications.default_level    = INFO {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] notifications.notification_format = unversioned {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] notifications.notify_on_state_change = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] pci.alias                      = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] pci.device_spec                = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] pci.report_in_placement        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.auth_section         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.auth_type            = password {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.cafile               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.certfile             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.collect_timing       = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.connect_retries      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.connect_retry_delay  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.default_domain_id    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.default_domain_name  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.domain_id            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.domain_name          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.endpoint_override    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.insecure             = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.keyfile              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.max_version          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.min_version          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.password             = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.project_domain_id    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.project_domain_name  = Default {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.project_id           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.project_name         = service {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.region_name          = RegionOne {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.service_name         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.service_type         = placement {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.split_loggers        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.status_code_retries  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.system_scope         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.timeout              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.trust_id             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.user_domain_id       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.user_domain_name     = Default {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.user_id              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.username             = placement {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] placement.version              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.cores                    = 20 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.count_usage_from_placement = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.injected_file_content_bytes = 10240 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.injected_file_path_length = 255 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.injected_files           = 5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.instances                = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.key_pairs                = 100 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.metadata_items           = 128 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.ram                      = 51200 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.recheck_quota            = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.server_group_members     = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] quota.server_groups            = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rdp.enabled                    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.image_metadata_prefilter = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.max_attempts         = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.max_placement_results = 1000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.query_placement_for_image_type_support = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] scheduler.workers              = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.host_subset_size = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.isolated_hosts = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.isolated_images = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.pci_in_placement = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.track_instance_changes = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metrics.required               = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metrics.weight_multiplier      = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] metrics.weight_setting         = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] serial_console.enabled         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] serial_console.port_range      = 10000:20000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] serial_console.serialproxy_port = 6083 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.auth_section      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.auth_type         = password {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.cafile            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.certfile          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.collect_timing    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.insecure          = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.keyfile           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.send_service_user_token = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.split_loggers     = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] service_user.timeout           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.agent_enabled            = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.enabled                  = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.html5proxy_port          = 6082 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.image_compression        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.jpeg_compression         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.playback_compression     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.server_listen            = 127.0.0.1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.streaming_mode           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] spice.zlib_compression         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] upgrade_levels.baseapi         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] upgrade_levels.cert            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] upgrade_levels.compute         = auto {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] upgrade_levels.conductor       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] upgrade_levels.scheduler       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.auth_section = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.auth_type = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.cafile = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.certfile = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.insecure = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.keyfile = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vendordata_dynamic_auth.timeout = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.api_retry_count         = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.ca_file                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.cache_prefix            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.cluster_name            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.connection_pool_size    = 10 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.console_delay_seconds   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.datastore_regex         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.host_ip                 = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.host_password           = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.host_port               = 443 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.host_username           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.insecure                = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.integration_bridge      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.maximum_objects         = 100 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.pbm_default_policy      = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.pbm_enabled             = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.pbm_wsdl_location       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.serial_port_proxy_uri   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.serial_port_service_uri = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.task_poll_interval      = 0.5 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.use_linked_clone        = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.vnc_keymap              = en-us {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.vnc_port                = 5900 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vmware.vnc_port_total          = 10000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.auth_schemes               = ['none'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.enabled                    = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.novncproxy_port            = 6080 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.server_listen              = 0.0.0.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.vencrypt_ca_certs          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.vencrypt_client_cert       = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vnc.vencrypt_client_key        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.disable_rootwrap   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.enable_numa_live_migration = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.libvirt_disable_apic = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.client_socket_timeout     = 900 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.default_pool_size         = 1000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.keep_alive                = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.max_header_line           = 16384 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.ssl_ca_file               = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.ssl_cert_file             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.ssl_key_file              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.tcp_keepidle              = 600 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] zvm.ca_file                    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] zvm.cloud_connector_url        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] zvm.reachable_timeout          = 300 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.enforce_new_defaults = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.enforce_scope      = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.policy_default_rule = default {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.policy_file        = policy.yaml {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.connection_string     = messaging:// {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.enabled               = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.es_doc_type           = notification {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.es_scroll_size        = 10000 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.es_scroll_time        = 2m {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.filter_error_trace    = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.hmac_keys             = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.sentinel_service_name = mymaster {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.socket_timeout        = 0.1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.trace_requests        = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler.trace_sqlalchemy      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler_jaeger.process_tags   = {} {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler_jaeger.service_name_prefix = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] profiler_otlp.service_name_prefix = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] remote_debug.host              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] remote_debug.port              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.ssl      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_notifications.retry = -1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_messaging_notifications.transport_url = **** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.auth_section        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.auth_type           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.cafile              = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.certfile            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.collect_timing      = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.connect_retries     = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.connect_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.endpoint_id         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.endpoint_override   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.insecure            = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.keyfile             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.max_version         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.min_version         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.region_name         = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.service_name        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.service_type        = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.split_loggers       = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.status_code_retries = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.status_code_retry_delay = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.timeout             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.valid_interfaces    = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_limit.version             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_reports.file_event_handler = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] oslo_reports.log_dir           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_ovs_privileged.group  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] vif_plug_ovs_privileged.user   = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.flat_interface = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.isolate_vif         = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_vif_ovs.per_port_bridge     = False {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] os_brick.lock_path             = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] privsep_osbrick.capabilities   = [21] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] privsep_osbrick.group          = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] privsep_osbrick.helper_command = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] privsep_osbrick.user           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] nova_sys_admin.group           = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] nova_sys_admin.helper_command  = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] nova_sys_admin.user            = None {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG oslo_service.service [None req-16cc3c28-83b9-4711-a018-d54afc4e559b None None] ******************************************************************************** {{(pid=74429) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 23 19:55:07 user nova-compute[74429]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Connecting to libvirt: qemu:///system {{(pid=74429) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7d5947a530> {{(pid=74429) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 23 19:55:07 user nova-compute[74429]: libvirt:  error : internal error: could not initialize domain event timer
Oct 23 19:55:07 user nova-compute[74429]: WARNING nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7d5947a530> {{(pid=74429) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Starting native event thread {{(pid=74429) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Starting green dispatch thread {{(pid=74429) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Starting connection event dispatch thread {{(pid=74429) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 23 19:55:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Connection event '1' reason 'None'
Oct 23 19:55:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 19:55:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.mount [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Initialising _HostMountState generation 0 {{(pid=74429) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 23 19:55:14 user nova-compute[74429]: INFO nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host capabilities <capabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <host>
Oct 23 19:55:14 user nova-compute[74429]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 23 19:55:14 user nova-compute[74429]:     <cpu>
Oct 23 19:55:14 user nova-compute[74429]:       <arch>x86_64</arch>
Oct 23 19:55:14 user nova-compute[74429]:       <model>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <microcode version='1070'/>
Oct 23 19:55:14 user nova-compute[74429]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='osxsave'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='invtsc'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='rsba'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature name='skip-l1dfl-vmentry'/>
Oct 23 19:55:14 user nova-compute[74429]:       <pages unit='KiB' size='4'/>
Oct 23 19:55:14 user nova-compute[74429]:       <pages unit='KiB' size='2048'/>
Oct 23 19:55:14 user nova-compute[74429]:     </cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <power_management>
Oct 23 19:55:14 user nova-compute[74429]:       <suspend_mem/>
Oct 23 19:55:14 user nova-compute[74429]:       <suspend_disk/>
Oct 23 19:55:14 user nova-compute[74429]:       <suspend_hybrid/>
Oct 23 19:55:14 user nova-compute[74429]:     </power_management>
Oct 23 19:55:14 user nova-compute[74429]:     <iommu support='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <migration_features>
Oct 23 19:55:14 user nova-compute[74429]:       <live/>
Oct 23 19:55:14 user nova-compute[74429]:       <uri_transports>
Oct 23 19:55:14 user nova-compute[74429]:         <uri_transport>tcp</uri_transport>
Oct 23 19:55:14 user nova-compute[74429]:         <uri_transport>rdma</uri_transport>
Oct 23 19:55:14 user nova-compute[74429]:       </uri_transports>
Oct 23 19:55:14 user nova-compute[74429]:     </migration_features>
Oct 23 19:55:14 user nova-compute[74429]:     <topology>
Oct 23 19:55:14 user nova-compute[74429]:       <cells num='2'>
Oct 23 19:55:14 user nova-compute[74429]:         <cell id='0'>
Oct 23 19:55:14 user nova-compute[74429]:           <memory unit='KiB'>8140616</memory>
Oct 23 19:55:14 user nova-compute[74429]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 23 19:55:14 user nova-compute[74429]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 19:55:14 user nova-compute[74429]:           <distances>
Oct 23 19:55:14 user nova-compute[74429]:             <sibling id='0' value='10'/>
Oct 23 19:55:14 user nova-compute[74429]:             <sibling id='1' value='20'/>
Oct 23 19:55:14 user nova-compute[74429]:           </distances>
Oct 23 19:55:14 user nova-compute[74429]:           <cpus num='6'>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 23 19:55:14 user nova-compute[74429]:           </cpus>
Oct 23 19:55:14 user nova-compute[74429]:         </cell>
Oct 23 19:55:14 user nova-compute[74429]:         <cell id='1'>
Oct 23 19:55:14 user nova-compute[74429]:           <memory unit='KiB'>8255068</memory>
Oct 23 19:55:14 user nova-compute[74429]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 23 19:55:14 user nova-compute[74429]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 19:55:14 user nova-compute[74429]:           <distances>
Oct 23 19:55:14 user nova-compute[74429]:             <sibling id='0' value='20'/>
Oct 23 19:55:14 user nova-compute[74429]:             <sibling id='1' value='10'/>
Oct 23 19:55:14 user nova-compute[74429]:           </distances>
Oct 23 19:55:14 user nova-compute[74429]:           <cpus num='6'>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 23 19:55:14 user nova-compute[74429]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 23 19:55:14 user nova-compute[74429]:           </cpus>
Oct 23 19:55:14 user nova-compute[74429]:         </cell>
Oct 23 19:55:14 user nova-compute[74429]:       </cells>
Oct 23 19:55:14 user nova-compute[74429]:     </topology>
Oct 23 19:55:14 user nova-compute[74429]:     <cache>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 23 19:55:14 user nova-compute[74429]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 23 19:55:14 user nova-compute[74429]:     </cache>
Oct 23 19:55:14 user nova-compute[74429]:     <secmodel>
Oct 23 19:55:14 user nova-compute[74429]:       <model>apparmor</model>
Oct 23 19:55:14 user nova-compute[74429]:       <doi>0</doi>
Oct 23 19:55:14 user nova-compute[74429]:     </secmodel>
Oct 23 19:55:14 user nova-compute[74429]:     <secmodel>
Oct 23 19:55:14 user nova-compute[74429]:       <model>dac</model>
Oct 23 19:55:14 user nova-compute[74429]:       <doi>0</doi>
Oct 23 19:55:14 user nova-compute[74429]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 23 19:55:14 user nova-compute[74429]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 23 19:55:14 user nova-compute[74429]:     </secmodel>
Oct 23 19:55:14 user nova-compute[74429]:   </host>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='alpha'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>clipper</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='armv6l'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>spitz</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>nuri</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>kzm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sx1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>z2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>tosa</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>n810</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>n800</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>terrier</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>midway</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>microbit</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>verdex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>highbank</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>akita</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>connex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>collie</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='armv7l'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>spitz</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>nuri</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>kzm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sx1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>z2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>tosa</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>n810</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>n800</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>terrier</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>midway</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>microbit</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>verdex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>highbank</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>akita</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>connex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>collie</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='aarch64'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>spitz</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>nuri</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>kzm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sx1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>z2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>tosa</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>n810</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>n800</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>terrier</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>midway</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>microbit</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>verdex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>raspi3b</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>highbank</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>akita</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>connex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>collie</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <acpi default='on' toggle='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='cris'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='i686'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>isapc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>microvm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='kvm'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <pae/>
Oct 23 19:55:14 user nova-compute[74429]:       <nonpae/>
Oct 23 19:55:14 user nova-compute[74429]:       <acpi default='on' toggle='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:       <apic default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='m68k'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>an5206</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>q800</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>next-cube</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='microblaze'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='microblazeel'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='mips'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='16'>malta</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='mipsel'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='16'>malta</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='mips64'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='16'>malta</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>pica61</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>magnum</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='mips64el'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='16'>malta</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>pica61</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>magnum</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='16'>boston</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='ppc'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mac99</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>40p</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>taihu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='ppc64'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>taihu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>40p</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mac99</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='ppc64le'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>taihu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>40p</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>mac99</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='riscv32'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='8'>spike</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>opentitan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='8'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='riscv64'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='8'>spike</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>shakti_c</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='8'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='s390x'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='sh4'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>shix</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>r2d</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='sh4eb'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>shix</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>r2d</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='sparc'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>SS-5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>SS-20</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>LX</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>SS-4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>SS-10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>Voyager</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='sparc64'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sun4u</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>niagara</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>sun4v</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='x86_64'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>64</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='1'>isapc</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>microvm</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='kvm'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <acpi default='on' toggle='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:       <apic default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='xtensa'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>sim</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>kc705</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ml605</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx200</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx60</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]:   <guest>
Oct 23 19:55:14 user nova-compute[74429]:     <os_type>hvm</os_type>
Oct 23 19:55:14 user nova-compute[74429]:     <arch name='xtensaeb'>
Oct 23 19:55:14 user nova-compute[74429]:       <wordsize>32</wordsize>
Oct 23 19:55:14 user nova-compute[74429]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='4'>sim</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>kc705</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ml605</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>virt</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx200</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>lx60</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 19:55:14 user nova-compute[74429]:       <domain type='qemu'/>
Oct 23 19:55:14 user nova-compute[74429]:     </arch>
Oct 23 19:55:14 user nova-compute[74429]:     <features>
Oct 23 19:55:14 user nova-compute[74429]:       <cpuselection/>
Oct 23 19:55:14 user nova-compute[74429]:       <deviceboot/>
Oct 23 19:55:14 user nova-compute[74429]:       <disksnapshot default='on' toggle='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     </features>
Oct 23 19:55:14 user nova-compute[74429]:   </guest>
Oct 23 19:55:14 user nova-compute[74429]: </capabilities>
Oct 23 19:55:14 user nova-compute[74429]: 
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-i440fx-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>i686</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='255'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'/>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='lm'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ide</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-q35-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>i686</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='288'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'/>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='lm'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-i440fx-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>i686</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='255'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'/>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='lm'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ide</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-q35-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>i686</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='288'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'/>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='lm'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-i440fx-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>x86_64</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='255'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>efi</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='invtsc'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='rsba'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ide</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-q35-6.2</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>x86_64</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='288'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>efi</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='invtsc'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='rsba'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-i440fx-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>x86_64</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='255'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>efi</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='invtsc'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='rsba'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ide</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 23 19:55:14 user nova-compute[74429]: <domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 19:55:14 user nova-compute[74429]:   <domain>kvm</domain>
Oct 23 19:55:14 user nova-compute[74429]:   <machine>pc-q35-jammy</machine>
Oct 23 19:55:14 user nova-compute[74429]:   <arch>x86_64</arch>
Oct 23 19:55:14 user nova-compute[74429]:   <vcpu max='288'/>
Oct 23 19:55:14 user nova-compute[74429]:   <iothreads supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:   <os supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='firmware'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>efi</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:     <loader supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>rom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pflash</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='readonly'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='secure'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>yes</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>no</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </loader>
Oct 23 19:55:14 user nova-compute[74429]:   </os>
Oct 23 19:55:14 user nova-compute[74429]:   <cpu>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-passthrough' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='hostPassthroughMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='maximum' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='maximumMigratable'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>on</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>off</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='host-model' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <vendor>Intel</vendor>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ss'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='vmx'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pcid'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='hypervisor'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arat'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='umip'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='md-clear'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='invtsc'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibpb'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='ibrs'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-stibp'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='rsba'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='erms'/>
Oct 23 19:55:14 user nova-compute[74429]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:     <mode name='custom' supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>qemu64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>qemu32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>phenom</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>pentium</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>n270</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm64</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>kvm32</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>coreduo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>core2duo</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>athlon</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Westmere</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Snowridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Skylake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>SandyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Penryn</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G5</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G4</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G3</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Opteron_G2</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Opteron_G1</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>IvyBridge</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Icelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Haswell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Rome</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-Milan</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>EPYC</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Dhyana</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cooperlake</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>Conroe</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='no'>Broadwell</model>
Oct 23 19:55:14 user nova-compute[74429]:       <model usable='yes'>486</model>
Oct 23 19:55:14 user nova-compute[74429]:     </mode>
Oct 23 19:55:14 user nova-compute[74429]:   </cpu>
Oct 23 19:55:14 user nova-compute[74429]:   <memoryBacking supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:     <enum name='sourceType'>
Oct 23 19:55:14 user nova-compute[74429]:       <value>file</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>anonymous</value>
Oct 23 19:55:14 user nova-compute[74429]:       <value>memfd</value>
Oct 23 19:55:14 user nova-compute[74429]:     </enum>
Oct 23 19:55:14 user nova-compute[74429]:   </memoryBacking>
Oct 23 19:55:14 user nova-compute[74429]:   <devices>
Oct 23 19:55:14 user nova-compute[74429]:     <disk supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='diskDevice'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>disk</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cdrom</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>floppy</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>lun</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='bus'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>fdc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sata</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </disk>
Oct 23 19:55:14 user nova-compute[74429]:     <graphics supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='type'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>sdl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vnc</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>spice</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egl-headless</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </graphics>
Oct 23 19:55:14 user nova-compute[74429]:     <video supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='modelType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>cirrus</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>vmvga</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>qxl</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>none</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>bochs</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>ramfb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </video>
Oct 23 19:55:14 user nova-compute[74429]:     <hostdev supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='mode'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>subsystem</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='startupPolicy'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>default</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>mandatory</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>requisite</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>optional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='subsysType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>usb</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>pci</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>scsi</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='capsType'/>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='pciBackend'/>
Oct 23 19:55:14 user nova-compute[74429]:     </hostdev>
Oct 23 19:55:14 user nova-compute[74429]:     <rng supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtio-non-transitional</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>random</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>egd</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>builtin</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </rng>
Oct 23 19:55:14 user nova-compute[74429]:     <filesystem supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='driverType'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>path</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>handle</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>virtiofs</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </filesystem>
Oct 23 19:55:14 user nova-compute[74429]:     <tpm supported='yes'>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='model'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-tis</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>tpm-crb</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:       <enum name='backendModel'>
Oct 23 19:55:14 user nova-compute[74429]:         <value>passthrough</value>
Oct 23 19:55:14 user nova-compute[74429]:         <value>emulator</value>
Oct 23 19:55:14 user nova-compute[74429]:       </enum>
Oct 23 19:55:14 user nova-compute[74429]:     </tpm>
Oct 23 19:55:14 user nova-compute[74429]:   </devices>
Oct 23 19:55:14 user nova-compute[74429]:   <features>
Oct 23 19:55:14 user nova-compute[74429]:     <gic supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:     <vmcoreinfo supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <genid supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backingStoreInput supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <backup supported='yes'/>
Oct 23 19:55:14 user nova-compute[74429]:     <sev supported='no'/>
Oct 23 19:55:14 user nova-compute[74429]:   </features>
Oct 23 19:55:14 user nova-compute[74429]: </domainCapabilities>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74429) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74429) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Checking secure boot support for host arch (x86_64) {{(pid=74429) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Checking secure boot support for host arch (x86_64) {{(pid=74429) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Checking secure boot support for host arch (x86_64) {{(pid=74429) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 19:55:14 user nova-compute[74429]: INFO nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Secure Boot support detected
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] cpu compare xml: <cpu match="exact">
Oct 23 19:55:14 user nova-compute[74429]:   <model>Nehalem</model>
Oct 23 19:55:14 user nova-compute[74429]: </cpu>
Oct 23 19:55:14 user nova-compute[74429]:  {{(pid=74429) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 23 19:55:14 user nova-compute[74429]: INFO nova.virt.node [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Generated node identity a94720e8-5668-448c-953f-7356c8921b17
Oct 23 19:55:14 user nova-compute[74429]: INFO nova.virt.node [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Wrote node identity a94720e8-5668-448c-953f-7356c8921b17 to /opt/stack/data/nova/compute_id
Oct 23 19:55:14 user nova-compute[74429]: WARNING nova.compute.manager [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Compute nodes ['a94720e8-5668-448c-953f-7356c8921b17'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 23 19:55:14 user nova-compute[74429]: INFO nova.compute.manager [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 23 19:55:14 user nova-compute[74429]: WARNING nova.compute.manager [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 19:55:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:55:14 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 19:55:15 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:55:15 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Hypervisor/Node resource view: name=user free_ram=10932MB free_disk=26.34564208984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:55:15 user nova-compute[74429]: WARNING nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] No compute node record for user:a94720e8-5668-448c-953f-7356c8921b17: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a94720e8-5668-448c-953f-7356c8921b17 could not be found.
Oct 23 19:55:15 user nova-compute[74429]: INFO nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Compute node record created for user:user with uuid: a94720e8-5668-448c-953f-7356c8921b17
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 19:55:15 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] [req-7dfbe7a5-b9d6-4bd6-b6a0-b87cd36f89af] Created resource provider record via placement API for resource provider with UUID a94720e8-5668-448c-953f-7356c8921b17 and name user.
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74429) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 23 19:55:15 user nova-compute[74429]: INFO nova.virt.libvirt.host [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] kernel doesn't support AMD SEV
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Libvirt baseline CPU <cpu>
Oct 23 19:55:15 user nova-compute[74429]:   <arch>x86_64</arch>
Oct 23 19:55:15 user nova-compute[74429]:   <model>Nehalem</model>
Oct 23 19:55:15 user nova-compute[74429]:   <vendor>Intel</vendor>
Oct 23 19:55:15 user nova-compute[74429]:   <topology sockets="6" cores="1" threads="1"/>
Oct 23 19:55:15 user nova-compute[74429]: </cpu>
Oct 23 19:55:15 user nova-compute[74429]:  {{(pid=74429) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Updated inventory for provider a94720e8-5668-448c-953f-7356c8921b17 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Updating resource provider a94720e8-5668-448c-953f-7356c8921b17 generation from 0 to 1 during operation: update_inventory {{(pid=74429) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Updating resource provider a94720e8-5668-448c-953f-7356c8921b17 generation from 1 to 2 during operation: update_traits {{(pid=74429) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.service [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Creating RPC server for service compute {{(pid=74429) start /opt/stack/nova/nova/service.py:182}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.service [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] Join ServiceGroup membership for this service compute {{(pid=74429) start /opt/stack/nova/nova/service.py:199}}
Oct 23 19:55:15 user nova-compute[74429]: DEBUG nova.servicegroup.drivers.db [None req-37bf719f-92fa-43be-bd69-487253b7e529 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74429) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 23 19:55:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:55:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:56:06 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 19:56:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:56:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:56:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=10375MB free_disk=26.249366760253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 19:56:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 19:57:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:57:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=26.313613891601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 19:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:57:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 19:58:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:58:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 19:58:08 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:58:08 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=26.067203521728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 19:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 19:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:58:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 19:58:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 19:58:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 19:59:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 19:59:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:09 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 19:59:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9570MB free_disk=26.086910247802734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 19:59:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 19:59:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 19:59:17 user nova-compute[74429]: INFO nova.compute.claims [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Claim successful on node user
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 19:59:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 19:59:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 19:59:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Creating image(s)
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "/opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "/opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG nova.policy [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '734b0b0d04104bfeab582780b77764cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201753405b7c4553af3b39f82311a3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.part --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG nova.virt.images [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] 2ada0c77-c749-4517-8f1f-639beb4e6c0a was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.part /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.part /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.converted" returned: 0 in 0.229s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.973s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:19 user nova-compute[74429]: INFO oslo.privsep.daemon [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1o5wgrpf/privsep.sock']
Oct 23 19:59:19 user sudo[83785]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1o5wgrpf/privsep.sock
Oct 23 19:59:19 user sudo[83785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 19:59:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Successfully created port: 83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 19:59:20 user nova-compute[74429]: INFO nova.compute.claims [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Claim successful on node user
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Successfully updated port: 83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquired lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:20 user sudo[83785]: pam_unix(sudo:session): session closed for user root
Oct 23 19:59:20 user nova-compute[74429]: INFO oslo.privsep.daemon [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Spawned new privsep daemon via rootwrap
Oct 23 19:59:20 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 19:59:20 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 19:59:20 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 23 19:59:20 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83799
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 19:59:20 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-changed-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Refreshing instance network info cache due to event network-changed-83a41e75-0f8b-4af5-9d69-518b6d12d356. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] Acquiring lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 19:59:20 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Creating image(s)
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "/opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "/opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.policy [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93f98ed657864e77ac02003f9e960778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f35111cd84e4675a2c24ab7a281e864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.215s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updating instance_info_cache with network_info: [{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk 1073741824" returned: 0 in 0.054s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.192s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Releasing lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Instance network_info: |[{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] Acquired lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Refreshing network info cache for port 83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 19:59:21 user nova-compute[74429]: INFO nova.compute.claims [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Claim successful on node user
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.262s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.252s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk 1073741824" returned: 0 in 0.056s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Cannot resize image /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Ensure instance console log exists: /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Start _get_guest_xml network_info=[{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 19:59:21 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:21 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1483926802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1483926802',id=1,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-pg10sb06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:18Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=dc41e78e-050f-429e-b0b9-f4473a07c2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'pci_devices' on Instance uuid dc41e78e-050f-429e-b0b9-f4473a07c2c7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 19:59:21 user nova-compute[74429]:   <uuid>dc41e78e-050f-429e-b0b9-f4473a07c2c7</uuid>
Oct 23 19:59:21 user nova-compute[74429]:   <name>instance-00000001</name>
Oct 23 19:59:21 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 19:59:21 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 19:59:21 user nova-compute[74429]:   <metadata>
Oct 23 19:59:21 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 19:59:21 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 19:59:21 user nova-compute[74429]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1483926802</nova:name>
Oct 23 19:59:21 user nova-compute[74429]:       <nova:creationTime>2023-10-23 19:59:21</nova:creationTime>
Oct 23 19:59:21 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 19:59:21 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 19:59:21 user nova-compute[74429]:       </nova:flavor>
Oct 23 19:59:21 user nova-compute[74429]:       <nova:owner>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:user uuid="734b0b0d04104bfeab582780b77764cf">tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member</nova:user>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:project uuid="201753405b7c4553af3b39f82311a3d2">tempest-ServerBootFromVolumeStableRescueTest-1279644555</nova:project>
Oct 23 19:59:21 user nova-compute[74429]:       </nova:owner>
Oct 23 19:59:21 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 19:59:21 user nova-compute[74429]:       <nova:ports>
Oct 23 19:59:21 user nova-compute[74429]:         <nova:port uuid="83a41e75-0f8b-4af5-9d69-518b6d12d356">
Oct 23 19:59:21 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 19:59:21 user nova-compute[74429]:         </nova:port>
Oct 23 19:59:21 user nova-compute[74429]:       </nova:ports>
Oct 23 19:59:21 user nova-compute[74429]:     </nova:instance>
Oct 23 19:59:21 user nova-compute[74429]:   </metadata>
Oct 23 19:59:21 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 19:59:21 user nova-compute[74429]:     <system>
Oct 23 19:59:21 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 19:59:21 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 19:59:21 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 19:59:21 user nova-compute[74429]:       <entry name="serial">dc41e78e-050f-429e-b0b9-f4473a07c2c7</entry>
Oct 23 19:59:21 user nova-compute[74429]:       <entry name="uuid">dc41e78e-050f-429e-b0b9-f4473a07c2c7</entry>
Oct 23 19:59:21 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 19:59:21 user nova-compute[74429]:     </system>
Oct 23 19:59:21 user nova-compute[74429]:   </sysinfo>
Oct 23 19:59:21 user nova-compute[74429]:   <os>
Oct 23 19:59:21 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 19:59:21 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 19:59:21 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 19:59:21 user nova-compute[74429]:   </os>
Oct 23 19:59:21 user nova-compute[74429]:   <features>
Oct 23 19:59:21 user nova-compute[74429]:     <acpi/>
Oct 23 19:59:21 user nova-compute[74429]:     <apic/>
Oct 23 19:59:21 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 19:59:21 user nova-compute[74429]:   </features>
Oct 23 19:59:21 user nova-compute[74429]:   <clock offset="utc">
Oct 23 19:59:21 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 19:59:21 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 19:59:21 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 19:59:21 user nova-compute[74429]:   </clock>
Oct 23 19:59:21 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 19:59:21 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 19:59:21 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 19:59:21 user nova-compute[74429]:   </cpu>
Oct 23 19:59:21 user nova-compute[74429]:   <devices>
Oct 23 19:59:21 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 19:59:21 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 19:59:21 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk"/>
Oct 23 19:59:21 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 19:59:21 user nova-compute[74429]:     </disk>
Oct 23 19:59:21 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 19:59:21 user nova-compute[74429]:       <mac address="fa:16:3e:fc:53:06"/>
Oct 23 19:59:21 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:21 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 19:59:21 user nova-compute[74429]:       <target dev="tap83a41e75-0f"/>
Oct 23 19:59:21 user nova-compute[74429]:     </interface>
Oct 23 19:59:21 user nova-compute[74429]:     <serial type="pty">
Oct 23 19:59:21 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/console.log" append="off"/>
Oct 23 19:59:21 user nova-compute[74429]:     </serial>
Oct 23 19:59:21 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 19:59:21 user nova-compute[74429]:     <video>
Oct 23 19:59:21 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:21 user nova-compute[74429]:     </video>
Oct 23 19:59:21 user nova-compute[74429]:     <rng model="virtio">
Oct 23 19:59:21 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 19:59:21 user nova-compute[74429]:     </rng>
Oct 23 19:59:21 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 19:59:21 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 19:59:21 user nova-compute[74429]:       <stats period="10"/>
Oct 23 19:59:21 user nova-compute[74429]:     </memballoon>
Oct 23 19:59:21 user nova-compute[74429]:   </devices>
Oct 23 19:59:21 user nova-compute[74429]: </domain>
Oct 23 19:59:21 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1483926802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1483926802',id=1,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-pg10sb06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:18Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=dc41e78e-050f-429e-b0b9-f4473a07c2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:21 user nova-compute[74429]: DEBUG os_vif [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Created schema index Interface.name {{(pid=74429) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Created schema index Port.name {{(pid=74429) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Created schema index Bridge.name {{(pid=74429) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [POLLOUT] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 19:59:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Cannot resize image /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Ensure instance console log exists: /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0da2b7f3-9035-5b07-9c33-4341a92617d8', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:22 user nova-compute[74429]: INFO oslo.privsep.daemon [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp2j6gfo19/privsep.sock']
Oct 23 19:59:22 user sudo[83842]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp2j6gfo19/privsep.sock
Oct 23 19:59:22 user sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.policy [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dc4633f95ff40f4a2859c6673112f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07fe256e3f84a4594ecccfc011aeea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 19:59:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Creating image(s)
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Successfully created port: 312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updated VIF entry in instance network info cache for port 83a41e75-0f8b-4af5-9d69-518b6d12d356. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updating instance_info_cache with network_info: [{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19afa669-6b73-4e06-94f2-e642671cd058 req-5426b343-23a1-4460-a2b2-2aea560bc8cd service nova] Releasing lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk 1073741824" returned: 0 in 0.058s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 19:59:23 user nova-compute[74429]: INFO nova.compute.claims [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Claim successful on node user
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.255s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Cannot resize image /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Ensure instance console log exists: /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 19:59:23 user sudo[83842]: pam_unix(sudo:session): session closed for user root
Oct 23 19:59:23 user nova-compute[74429]: INFO oslo.privsep.daemon [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Spawned new privsep daemon via rootwrap
Oct 23 19:59:23 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 19:59:23 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 19:59:23 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 23 19:59:23 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83860
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Successfully created port: a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 19:59:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 19:59:23 user nova-compute[74429]: DEBUG nova.policy [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88700b7acce44892b2cb4fe00e1a25df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0451253f94380b18335a46be24fa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 19:59:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Creating image(s)
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.250s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83a41e75-0f, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83a41e75-0f, col_values=(('qos', UUID('43154415-20d8-4587-b2a1-f6450e02539f')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83a41e75-0f, col_values=(('external_ids', {'iface-id': '83a41e75-0f8b-4af5-9d69-518b6d12d356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:53:06', 'vm-uuid': 'dc41e78e-050f-429e-b0b9-f4473a07c2c7'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:24 user nova-compute[74429]: INFO os_vif [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f')
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Successfully updated port: 312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No VIF found with MAC fa:16:3e:fc:53:06, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquired lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.232s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-changed-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Refreshing instance network info cache due to event network-changed-312c09b5-717e-4cf0-9b83-b5fdc2cf4316. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] Acquiring lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk 1073741824" returned: 0 in 0.051s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.250s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Cannot resize image /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Ensure instance console log exists: /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Successfully updated port: a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updating instance_info_cache with network_info: [{"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Releasing lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Instance network_info: |[{"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] Acquired lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Refreshing network info cache for port 312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Start _get_guest_xml network_info=[{"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 19:59:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1739153548',display_name='tempest-DeleteServersTestJSON-server-1739153548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1739153548',id=2,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f35111cd84e4675a2c24ab7a281e864',ramdisk_id='',reservation_id='r-kkzsh00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1545853121',owner_user_name='tempest-DeleteServersTestJSON-1545853121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:21Z,user_data=None,user_id='93f98ed657864e77ac02003f9e960778',uuid=d1572158-f516-4454-96ce-4a5e720b4041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Converting VIF {"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.objects.instance [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lazy-loading 'pci_devices' on Instance uuid d1572158-f516-4454-96ce-4a5e720b4041 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] End _get_guest_xml xml=<domain type="kvm">
Oct 23 19:59:25 user nova-compute[74429]:   <uuid>d1572158-f516-4454-96ce-4a5e720b4041</uuid>
Oct 23 19:59:25 user nova-compute[74429]:   <name>instance-00000002</name>
Oct 23 19:59:25 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 19:59:25 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 19:59:25 user nova-compute[74429]:   <metadata>
Oct 23 19:59:25 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 19:59:25 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 19:59:25 user nova-compute[74429]:       <nova:name>tempest-DeleteServersTestJSON-server-1739153548</nova:name>
Oct 23 19:59:25 user nova-compute[74429]:       <nova:creationTime>2023-10-23 19:59:25</nova:creationTime>
Oct 23 19:59:25 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 19:59:25 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 19:59:25 user nova-compute[74429]:       </nova:flavor>
Oct 23 19:59:25 user nova-compute[74429]:       <nova:owner>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:user uuid="93f98ed657864e77ac02003f9e960778">tempest-DeleteServersTestJSON-1545853121-project-member</nova:user>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:project uuid="1f35111cd84e4675a2c24ab7a281e864">tempest-DeleteServersTestJSON-1545853121</nova:project>
Oct 23 19:59:25 user nova-compute[74429]:       </nova:owner>
Oct 23 19:59:25 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 19:59:25 user nova-compute[74429]:       <nova:ports>
Oct 23 19:59:25 user nova-compute[74429]:         <nova:port uuid="312c09b5-717e-4cf0-9b83-b5fdc2cf4316">
Oct 23 19:59:25 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 19:59:25 user nova-compute[74429]:         </nova:port>
Oct 23 19:59:25 user nova-compute[74429]:       </nova:ports>
Oct 23 19:59:25 user nova-compute[74429]:     </nova:instance>
Oct 23 19:59:25 user nova-compute[74429]:   </metadata>
Oct 23 19:59:25 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 19:59:25 user nova-compute[74429]:     <system>
Oct 23 19:59:25 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 19:59:25 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 19:59:25 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 19:59:25 user nova-compute[74429]:       <entry name="serial">d1572158-f516-4454-96ce-4a5e720b4041</entry>
Oct 23 19:59:25 user nova-compute[74429]:       <entry name="uuid">d1572158-f516-4454-96ce-4a5e720b4041</entry>
Oct 23 19:59:25 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 19:59:25 user nova-compute[74429]:     </system>
Oct 23 19:59:25 user nova-compute[74429]:   </sysinfo>
Oct 23 19:59:25 user nova-compute[74429]:   <os>
Oct 23 19:59:25 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 19:59:25 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 19:59:25 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 19:59:25 user nova-compute[74429]:   </os>
Oct 23 19:59:25 user nova-compute[74429]:   <features>
Oct 23 19:59:25 user nova-compute[74429]:     <acpi/>
Oct 23 19:59:25 user nova-compute[74429]:     <apic/>
Oct 23 19:59:25 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 19:59:25 user nova-compute[74429]:   </features>
Oct 23 19:59:25 user nova-compute[74429]:   <clock offset="utc">
Oct 23 19:59:25 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 19:59:25 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 19:59:25 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 19:59:25 user nova-compute[74429]:   </clock>
Oct 23 19:59:25 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 19:59:25 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 19:59:25 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 19:59:25 user nova-compute[74429]:   </cpu>
Oct 23 19:59:25 user nova-compute[74429]:   <devices>
Oct 23 19:59:25 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 19:59:25 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 19:59:25 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk"/>
Oct 23 19:59:25 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 19:59:25 user nova-compute[74429]:     </disk>
Oct 23 19:59:25 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 19:59:25 user nova-compute[74429]:       <mac address="fa:16:3e:12:dc:a9"/>
Oct 23 19:59:25 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:25 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 19:59:25 user nova-compute[74429]:       <target dev="tap312c09b5-71"/>
Oct 23 19:59:25 user nova-compute[74429]:     </interface>
Oct 23 19:59:25 user nova-compute[74429]:     <serial type="pty">
Oct 23 19:59:25 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/console.log" append="off"/>
Oct 23 19:59:25 user nova-compute[74429]:     </serial>
Oct 23 19:59:25 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 19:59:25 user nova-compute[74429]:     <video>
Oct 23 19:59:25 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:25 user nova-compute[74429]:     </video>
Oct 23 19:59:25 user nova-compute[74429]:     <rng model="virtio">
Oct 23 19:59:25 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 19:59:25 user nova-compute[74429]:     </rng>
Oct 23 19:59:25 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 19:59:25 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 19:59:25 user nova-compute[74429]:       <stats period="10"/>
Oct 23 19:59:25 user nova-compute[74429]:     </memballoon>
Oct 23 19:59:25 user nova-compute[74429]:   </devices>
Oct 23 19:59:25 user nova-compute[74429]: </domain>
Oct 23 19:59:25 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1739153548',display_name='tempest-DeleteServersTestJSON-server-1739153548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1739153548',id=2,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f35111cd84e4675a2c24ab7a281e864',ramdisk_id='',reservation_id='r-kkzsh00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1545853121',owner_user_name='tempest-DeleteServersTestJSON-1545853121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:21Z,user_data=None,user_id='93f98ed657864e77ac02003f9e960778',uuid=d1572158-f516-4454-96ce-4a5e720b4041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Converting VIF {"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG os_vif [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7de7723-fb8d-509e-a7b7-68154a904d2c', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap312c09b5-71, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap312c09b5-71, col_values=(('qos', UUID('59b5a2b1-954f-425f-971a-90520e312eb6')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap312c09b5-71, col_values=(('external_ids', {'iface-id': '312c09b5-717e-4cf0-9b83-b5fdc2cf4316', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:dc:a9', 'vm-uuid': 'd1572158-f516-4454-96ce-4a5e720b4041'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: INFO os_vif [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71')
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] No VIF found with MAC fa:16:3e:12:dc:a9, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance network_info: |[{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start _get_guest_xml network_info=[{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 19:59:26 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:26 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Successfully created port: 2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.objects.instance [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'pci_devices' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 19:59:26 user nova-compute[74429]:   <uuid>44034c15-e9c6-466b-959a-534b818bab5c</uuid>
Oct 23 19:59:26 user nova-compute[74429]:   <name>instance-00000003</name>
Oct 23 19:59:26 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 19:59:26 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 19:59:26 user nova-compute[74429]:   <metadata>
Oct 23 19:59:26 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 19:59:26 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 19:59:26 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherB-server-594920033</nova:name>
Oct 23 19:59:26 user nova-compute[74429]:       <nova:creationTime>2023-10-23 19:59:26</nova:creationTime>
Oct 23 19:59:26 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 19:59:26 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 19:59:26 user nova-compute[74429]:       </nova:flavor>
Oct 23 19:59:26 user nova-compute[74429]:       <nova:owner>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:user uuid="9dc4633f95ff40f4a2859c6673112f94">tempest-ServerActionsTestOtherB-1184256079-project-member</nova:user>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:project uuid="f07fe256e3f84a4594ecccfc011aeea3">tempest-ServerActionsTestOtherB-1184256079</nova:project>
Oct 23 19:59:26 user nova-compute[74429]:       </nova:owner>
Oct 23 19:59:26 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 19:59:26 user nova-compute[74429]:       <nova:ports>
Oct 23 19:59:26 user nova-compute[74429]:         <nova:port uuid="a6a5270f-79da-4735-a1f4-5bc0fac5259d">
Oct 23 19:59:26 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 19:59:26 user nova-compute[74429]:         </nova:port>
Oct 23 19:59:26 user nova-compute[74429]:       </nova:ports>
Oct 23 19:59:26 user nova-compute[74429]:     </nova:instance>
Oct 23 19:59:26 user nova-compute[74429]:   </metadata>
Oct 23 19:59:26 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 19:59:26 user nova-compute[74429]:     <system>
Oct 23 19:59:26 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 19:59:26 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 19:59:26 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 19:59:26 user nova-compute[74429]:       <entry name="serial">44034c15-e9c6-466b-959a-534b818bab5c</entry>
Oct 23 19:59:26 user nova-compute[74429]:       <entry name="uuid">44034c15-e9c6-466b-959a-534b818bab5c</entry>
Oct 23 19:59:26 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 19:59:26 user nova-compute[74429]:     </system>
Oct 23 19:59:26 user nova-compute[74429]:   </sysinfo>
Oct 23 19:59:26 user nova-compute[74429]:   <os>
Oct 23 19:59:26 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 19:59:26 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 19:59:26 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 19:59:26 user nova-compute[74429]:   </os>
Oct 23 19:59:26 user nova-compute[74429]:   <features>
Oct 23 19:59:26 user nova-compute[74429]:     <acpi/>
Oct 23 19:59:26 user nova-compute[74429]:     <apic/>
Oct 23 19:59:26 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 19:59:26 user nova-compute[74429]:   </features>
Oct 23 19:59:26 user nova-compute[74429]:   <clock offset="utc">
Oct 23 19:59:26 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 19:59:26 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 19:59:26 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 19:59:26 user nova-compute[74429]:   </clock>
Oct 23 19:59:26 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 19:59:26 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 19:59:26 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 19:59:26 user nova-compute[74429]:   </cpu>
Oct 23 19:59:26 user nova-compute[74429]:   <devices>
Oct 23 19:59:26 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 19:59:26 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 19:59:26 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk"/>
Oct 23 19:59:26 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 19:59:26 user nova-compute[74429]:     </disk>
Oct 23 19:59:26 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 19:59:26 user nova-compute[74429]:       <mac address="fa:16:3e:7f:dd:c6"/>
Oct 23 19:59:26 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:26 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 19:59:26 user nova-compute[74429]:       <target dev="tapa6a5270f-79"/>
Oct 23 19:59:26 user nova-compute[74429]:     </interface>
Oct 23 19:59:26 user nova-compute[74429]:     <serial type="pty">
Oct 23 19:59:26 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/console.log" append="off"/>
Oct 23 19:59:26 user nova-compute[74429]:     </serial>
Oct 23 19:59:26 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 19:59:26 user nova-compute[74429]:     <video>
Oct 23 19:59:26 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:26 user nova-compute[74429]:     </video>
Oct 23 19:59:26 user nova-compute[74429]:     <rng model="virtio">
Oct 23 19:59:26 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 19:59:26 user nova-compute[74429]:     </rng>
Oct 23 19:59:26 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 19:59:26 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 19:59:26 user nova-compute[74429]:       <stats period="10"/>
Oct 23 19:59:26 user nova-compute[74429]:     </memballoon>
Oct 23 19:59:26 user nova-compute[74429]:   </devices>
Oct 23 19:59:26 user nova-compute[74429]: </domain>
Oct 23 19:59:26 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG os_vif [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updated VIF entry in instance network info cache for port 312c09b5-717e-4cf0-9b83-b5fdc2cf4316. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updating instance_info_cache with network_info: [{"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a222e76b-f9d5-5518-8b11-6361cb36abf8', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd934358-2016-4210-a31b-7a5551441b3c req-3b664704-ef48-4c86-8dee-a052bde19be3 service nova] Releasing lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6a5270f-79, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6a5270f-79, col_values=(('qos', UUID('0ccb4486-4c68-41ee-835e-bbd334fb1ce6')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6a5270f-79, col_values=(('external_ids', {'iface-id': 'a6a5270f-79da-4735-a1f4-5bc0fac5259d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:dd:c6', 'vm-uuid': '44034c15-e9c6-466b-959a-534b818bab5c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:26 user nova-compute[74429]: INFO os_vif [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79')
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No VIF found with MAC fa:16:3e:7f:dd:c6, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-changed-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Refreshing instance network info cache due to event network-changed-a6a5270f-79da-4735-a1f4-5bc0fac5259d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Refreshing network info cache for port a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG nova.network.neutron [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updated VIF entry in instance network info cache for port a6a5270f-79da-4735-a1f4-5bc0fac5259d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG nova.network.neutron [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Successfully updated port: 2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-46cee4ee-cd11-4c6a-9797-2f398612c316 req-7bd09f90-aed8-4ba5-8855-27e3c8d00226 service nova] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance network_info: |[{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Start _get_guest_xml network_info=[{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 19:59:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1699081527',display_name='tempest-ServerStableDeviceRescueTest-server-1699081527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1699081527',id=4,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2Jg3pnZIV6KdiWvNFbrI5BCvfS0w00IzRsIvTJ4VWI8DWNqRo5u9/MJx5Tsxja1iY+qnFhS+w3Qdtu3A4TDZnJ8qQfBHriSrG4xi723no/XkjimGWh+8PWeK/2SgP3Ww==',key_name='tempest-keypair-874344455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3f0451253f94380b18335a46be24fa1',ramdisk_id='',reservation_id='r-qbloz6l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1612166300',owner_user_name='tempest-ServerStableDeviceRescueTest-1612166300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88700b7acce44892b2cb4fe00e1a25df',uuid=a6709080-2cd7-4ee9-9d6e-7390fc5ae21b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converting VIF {"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'pci_devices' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 19:59:28 user nova-compute[74429]:   <uuid>a6709080-2cd7-4ee9-9d6e-7390fc5ae21b</uuid>
Oct 23 19:59:28 user nova-compute[74429]:   <name>instance-00000004</name>
Oct 23 19:59:28 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 19:59:28 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 19:59:28 user nova-compute[74429]:   <metadata>
Oct 23 19:59:28 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 19:59:28 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 19:59:28 user nova-compute[74429]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1699081527</nova:name>
Oct 23 19:59:28 user nova-compute[74429]:       <nova:creationTime>2023-10-23 19:59:28</nova:creationTime>
Oct 23 19:59:28 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 19:59:28 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 19:59:28 user nova-compute[74429]:       </nova:flavor>
Oct 23 19:59:28 user nova-compute[74429]:       <nova:owner>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:user uuid="88700b7acce44892b2cb4fe00e1a25df">tempest-ServerStableDeviceRescueTest-1612166300-project-member</nova:user>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:project uuid="a3f0451253f94380b18335a46be24fa1">tempest-ServerStableDeviceRescueTest-1612166300</nova:project>
Oct 23 19:59:28 user nova-compute[74429]:       </nova:owner>
Oct 23 19:59:28 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 19:59:28 user nova-compute[74429]:       <nova:ports>
Oct 23 19:59:28 user nova-compute[74429]:         <nova:port uuid="2d3359d2-106a-4f09-a6e7-d5cafc924c2b">
Oct 23 19:59:28 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 19:59:28 user nova-compute[74429]:         </nova:port>
Oct 23 19:59:28 user nova-compute[74429]:       </nova:ports>
Oct 23 19:59:28 user nova-compute[74429]:     </nova:instance>
Oct 23 19:59:28 user nova-compute[74429]:   </metadata>
Oct 23 19:59:28 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 19:59:28 user nova-compute[74429]:     <system>
Oct 23 19:59:28 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 19:59:28 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 19:59:28 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 19:59:28 user nova-compute[74429]:       <entry name="serial">a6709080-2cd7-4ee9-9d6e-7390fc5ae21b</entry>
Oct 23 19:59:28 user nova-compute[74429]:       <entry name="uuid">a6709080-2cd7-4ee9-9d6e-7390fc5ae21b</entry>
Oct 23 19:59:28 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 19:59:28 user nova-compute[74429]:     </system>
Oct 23 19:59:28 user nova-compute[74429]:   </sysinfo>
Oct 23 19:59:28 user nova-compute[74429]:   <os>
Oct 23 19:59:28 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 19:59:28 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 19:59:28 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 19:59:28 user nova-compute[74429]:   </os>
Oct 23 19:59:28 user nova-compute[74429]:   <features>
Oct 23 19:59:28 user nova-compute[74429]:     <acpi/>
Oct 23 19:59:28 user nova-compute[74429]:     <apic/>
Oct 23 19:59:28 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 19:59:28 user nova-compute[74429]:   </features>
Oct 23 19:59:28 user nova-compute[74429]:   <clock offset="utc">
Oct 23 19:59:28 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 19:59:28 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 19:59:28 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 19:59:28 user nova-compute[74429]:   </clock>
Oct 23 19:59:28 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 19:59:28 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 19:59:28 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 19:59:28 user nova-compute[74429]:   </cpu>
Oct 23 19:59:28 user nova-compute[74429]:   <devices>
Oct 23 19:59:28 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 19:59:28 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 19:59:28 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk"/>
Oct 23 19:59:28 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 19:59:28 user nova-compute[74429]:     </disk>
Oct 23 19:59:28 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 19:59:28 user nova-compute[74429]:       <mac address="fa:16:3e:00:37:0d"/>
Oct 23 19:59:28 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:28 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 19:59:28 user nova-compute[74429]:       <target dev="tap2d3359d2-10"/>
Oct 23 19:59:28 user nova-compute[74429]:     </interface>
Oct 23 19:59:28 user nova-compute[74429]:     <serial type="pty">
Oct 23 19:59:28 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/console.log" append="off"/>
Oct 23 19:59:28 user nova-compute[74429]:     </serial>
Oct 23 19:59:28 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 19:59:28 user nova-compute[74429]:     <video>
Oct 23 19:59:28 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:28 user nova-compute[74429]:     </video>
Oct 23 19:59:28 user nova-compute[74429]:     <rng model="virtio">
Oct 23 19:59:28 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 19:59:28 user nova-compute[74429]:     </rng>
Oct 23 19:59:28 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 19:59:28 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 19:59:28 user nova-compute[74429]:       <stats period="10"/>
Oct 23 19:59:28 user nova-compute[74429]:     </memballoon>
Oct 23 19:59:28 user nova-compute[74429]:   </devices>
Oct 23 19:59:28 user nova-compute[74429]: </domain>
Oct 23 19:59:28 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1699081527',display_name='tempest-ServerStableDeviceRescueTest-server-1699081527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1699081527',id=4,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2Jg3pnZIV6KdiWvNFbrI5BCvfS0w00IzRsIvTJ4VWI8DWNqRo5u9/MJx5Tsxja1iY+qnFhS+w3Qdtu3A4TDZnJ8qQfBHriSrG4xi723no/XkjimGWh+8PWeK/2SgP3Ww==',key_name='tempest-keypair-874344455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3f0451253f94380b18335a46be24fa1',ramdisk_id='',reservation_id='r-qbloz6l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1612166300',owner_user_name='tempest-ServerStableDeviceRescueTest-1612166300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88700b7acce44892b2cb4fe00e1a25df',uuid=a6709080-2cd7-4ee9-9d6e-7390fc5ae21b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converting VIF {"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG os_vif [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26178e32-6f45-55ab-94b0-e0a43c4098f4', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d3359d2-10, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d3359d2-10, col_values=(('qos', UUID('cfa98996-7d56-4c4b-955c-73f8e8068519')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d3359d2-10, col_values=(('external_ids', {'iface-id': '2d3359d2-106a-4f09-a6e7-d5cafc924c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:37:0d', 'vm-uuid': 'a6709080-2cd7-4ee9-9d6e-7390fc5ae21b'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: INFO os_vif [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10')
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No VIF found with MAC fa:16:3e:00:37:0d, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing instance network info cache due to event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:28 user nova-compute[74429]: DEBUG nova.network.neutron [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 19:59:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updated VIF entry in instance network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 19:59:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cc3cff24-3cba-4b87-9f9c-c210b1dd9d19 req-135ab93a-6a11-49cc-8645-4311401570c6 service nova] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 19:59:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Instance spawned successfully.
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:30 user nova-compute[74429]: INFO nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Took 12.19 seconds to spawn the instance on the hypervisor.
Oct 23 19:59:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 19:59:30 user nova-compute[74429]: INFO nova.compute.manager [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Took 13.34 seconds to build instance.
Oct 23 19:59:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a4bb5969-5fbd-4f13-b253-e9ecd37d4b03 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.563s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 19:59:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Instance spawned successfully.
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:33 user nova-compute[74429]: INFO nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Took 13.00 seconds to spawn the instance on the hypervisor.
Oct 23 19:59:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.compute.manager [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Took 13.99 seconds to build instance.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5f40c8a5-8570-4977-8532-ffb50a3c00c2 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.156s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance spawned successfully.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance spawned successfully.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Took 12.01 seconds to spawn the instance on the hypervisor.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Took 10.56 seconds to spawn the instance on the hypervisor.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.compute.manager [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Took 13.34 seconds to build instance.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-55620dc9-b07a-47eb-a208-f62dae2ce175 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.655s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:34 user nova-compute[74429]: INFO nova.compute.manager [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Took 11.84 seconds to build instance.
Oct 23 19:59:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6767f88b-b1eb-4c64-b84f-a0c26357b5d5 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.018s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 19:59:43 user nova-compute[74429]: INFO nova.compute.claims [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Claim successful on node user
Oct 23 19:59:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 19:59:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 23 19:59:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG nova.policy [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6a8f83b6a214c23ac062b7e0a59ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ae34326de4865a98b9260d44c7913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 19:59:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Creating image(s)
Oct 23 19:59:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "/opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "/opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "da8cad8c63346c7642a1419dfe93f34f6fdf4394" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "da8cad8c63346c7642a1419dfe93f34f6fdf4394" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG nova.virt.images [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] 4173a61a-278c-4170-b621-3855a804c821 was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.part /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.part /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.converted" returned: 0 in 0.275s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Successfully created port: 1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "da8cad8c63346c7642a1419dfe93f34f6fdf4394" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.367s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "da8cad8c63346c7642a1419dfe93f34f6fdf4394" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "da8cad8c63346c7642a1419dfe93f34f6fdf4394" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394,backing_fmt=raw /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394,backing_fmt=raw /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk 1073741824" returned: 0 in 0.053s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "da8cad8c63346c7642a1419dfe93f34f6fdf4394" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Successfully updated port: 1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-changed-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Refreshing instance network info cache due to event network-changed-1dea4302-ed87-4c99-9089-e02dae437431. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] Acquiring lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] Acquired lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Refreshing network info cache for port 1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Cannot resize image /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Ensure instance console log exists: /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.008s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8aabf57e-191e-4e28-8e89-7b49a852441f req-d74c8e3d-f5d6-4e6c-a52f-3c7c25f68d4c service nova] Releasing lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquired lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 19:59:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Updating instance_info_cache with network_info: [{"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Releasing lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Instance network_info: |[{"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Start _get_guest_xml network_info=[{"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:59:33Z,direct_url=<?>,disk_format='qcow2',id=4173a61a-278c-4170-b621-3855a804c821,min_disk=0,min_ram=0,name='',owner='2bb1b42d679b4b5b93016bcb62798d91',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:59:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_format': None, 'device_name': '/dev/sda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '4173a61a-278c-4170-b621-3855a804c821'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 19:59:47 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:47 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-56ae7881-f1db-4089-b2fd-af1be1173e9f req-2d71db5a-fa81-4d89-877d-0a246b9103cf service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-56ae7881-f1db-4089-b2fd-af1be1173e9f req-2d71db5a-fa81-4d89-877d-0a246b9103cf service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-56ae7881-f1db-4089-b2fd-af1be1173e9f req-2d71db5a-fa81-4d89-877d-0a246b9103cf service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-56ae7881-f1db-4089-b2fd-af1be1173e9f req-2d71db5a-fa81-4d89-877d-0a246b9103cf service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-56ae7881-f1db-4089-b2fd-af1be1173e9f req-2d71db5a-fa81-4d89-877d-0a246b9103cf service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:47 user nova-compute[74429]: WARNING nova.compute.manager [req-56ae7881-f1db-4089-b2fd-af1be1173e9f req-2d71db5a-fa81-4d89-877d-0a246b9103cf service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state None.
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:59:33Z,direct_url=<?>,disk_format='qcow2',id=4173a61a-278c-4170-b621-3855a804c821,min_disk=0,min_ram=0,name='',owner='2bb1b42d679b4b5b93016bcb62798d91',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:59:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T19:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1500447609',display_name='tempest-AttachSCSIVolumeTestJSON-server-1500447609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1500447609',id=5,image_ref='4173a61a-278c-4170-b621-3855a804c821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMElNpI/79AWwXCrpr3ouI39UOLj+tfq58hLhbQlMtCru40mV/P1eYpfckJvkrCV+OXCEK1t8HgU5Yrb7noQW2O5qgfpEOfkzFLJCZ7dTW78/8OvINBTi7iPT0V5fjr4gA==',key_name='tempest-keypair-929672768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03ae34326de4865a98b9260d44c7913',ramdisk_id='',reservation_id='r-50oiffp0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4173a61a-278c-4170-b621-3855a804c821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1074995272',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1074995272-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a8f83b6a214c23ac062b7e0a59ab95',uuid=fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Converting VIF {"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lazy-loading 'pci_devices' on Instance uuid fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 19:59:47 user nova-compute[74429]:   <uuid>fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5</uuid>
Oct 23 19:59:47 user nova-compute[74429]:   <name>instance-00000005</name>
Oct 23 19:59:47 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 19:59:47 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 19:59:47 user nova-compute[74429]:   <metadata>
Oct 23 19:59:47 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 19:59:47 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 19:59:47 user nova-compute[74429]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1500447609</nova:name>
Oct 23 19:59:47 user nova-compute[74429]:       <nova:creationTime>2023-10-23 19:59:47</nova:creationTime>
Oct 23 19:59:47 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 19:59:47 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 19:59:47 user nova-compute[74429]:       </nova:flavor>
Oct 23 19:59:47 user nova-compute[74429]:       <nova:owner>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:user uuid="b6a8f83b6a214c23ac062b7e0a59ab95">tempest-AttachSCSIVolumeTestJSON-1074995272-project-member</nova:user>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:project uuid="e03ae34326de4865a98b9260d44c7913">tempest-AttachSCSIVolumeTestJSON-1074995272</nova:project>
Oct 23 19:59:47 user nova-compute[74429]:       </nova:owner>
Oct 23 19:59:47 user nova-compute[74429]:       <nova:root type="image" uuid="4173a61a-278c-4170-b621-3855a804c821"/>
Oct 23 19:59:47 user nova-compute[74429]:       <nova:ports>
Oct 23 19:59:47 user nova-compute[74429]:         <nova:port uuid="1dea4302-ed87-4c99-9089-e02dae437431">
Oct 23 19:59:47 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 19:59:47 user nova-compute[74429]:         </nova:port>
Oct 23 19:59:47 user nova-compute[74429]:       </nova:ports>
Oct 23 19:59:47 user nova-compute[74429]:     </nova:instance>
Oct 23 19:59:47 user nova-compute[74429]:   </metadata>
Oct 23 19:59:47 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 19:59:47 user nova-compute[74429]:     <system>
Oct 23 19:59:47 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 19:59:47 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 19:59:47 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 19:59:47 user nova-compute[74429]:       <entry name="serial">fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5</entry>
Oct 23 19:59:47 user nova-compute[74429]:       <entry name="uuid">fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5</entry>
Oct 23 19:59:47 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 19:59:47 user nova-compute[74429]:     </system>
Oct 23 19:59:47 user nova-compute[74429]:   </sysinfo>
Oct 23 19:59:47 user nova-compute[74429]:   <os>
Oct 23 19:59:47 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 19:59:47 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 19:59:47 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 19:59:47 user nova-compute[74429]:   </os>
Oct 23 19:59:47 user nova-compute[74429]:   <features>
Oct 23 19:59:47 user nova-compute[74429]:     <acpi/>
Oct 23 19:59:47 user nova-compute[74429]:     <apic/>
Oct 23 19:59:47 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 19:59:47 user nova-compute[74429]:   </features>
Oct 23 19:59:47 user nova-compute[74429]:   <clock offset="utc">
Oct 23 19:59:47 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 19:59:47 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 19:59:47 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 19:59:47 user nova-compute[74429]:   </clock>
Oct 23 19:59:47 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 19:59:47 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 19:59:47 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 19:59:47 user nova-compute[74429]:   </cpu>
Oct 23 19:59:47 user nova-compute[74429]:   <devices>
Oct 23 19:59:47 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 19:59:47 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 19:59:47 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk"/>
Oct 23 19:59:47 user nova-compute[74429]:       <target dev="sda" bus="scsi"/>
Oct 23 19:59:47 user nova-compute[74429]:       <address type="drive" controller="0" unit="0"/>
Oct 23 19:59:47 user nova-compute[74429]:     </disk>
Oct 23 19:59:47 user nova-compute[74429]:     <disk type="file" device="cdrom">
Oct 23 19:59:47 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 19:59:47 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.config"/>
Oct 23 19:59:47 user nova-compute[74429]:       <target dev="sdb" bus="scsi"/>
Oct 23 19:59:47 user nova-compute[74429]:       <address type="drive" controller="0" unit="1"/>
Oct 23 19:59:47 user nova-compute[74429]:     </disk>
Oct 23 19:59:47 user nova-compute[74429]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 23 19:59:47 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 19:59:47 user nova-compute[74429]:       <mac address="fa:16:3e:54:d1:e1"/>
Oct 23 19:59:47 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:47 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 19:59:47 user nova-compute[74429]:       <target dev="tap1dea4302-ed"/>
Oct 23 19:59:47 user nova-compute[74429]:     </interface>
Oct 23 19:59:47 user nova-compute[74429]:     <serial type="pty">
Oct 23 19:59:47 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/console.log" append="off"/>
Oct 23 19:59:47 user nova-compute[74429]:     </serial>
Oct 23 19:59:47 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 19:59:47 user nova-compute[74429]:     <video>
Oct 23 19:59:47 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:47 user nova-compute[74429]:     </video>
Oct 23 19:59:47 user nova-compute[74429]:     <rng model="virtio">
Oct 23 19:59:47 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 19:59:47 user nova-compute[74429]:     </rng>
Oct 23 19:59:47 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 19:59:47 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 19:59:47 user nova-compute[74429]:       <stats period="10"/>
Oct 23 19:59:47 user nova-compute[74429]:     </memballoon>
Oct 23 19:59:47 user nova-compute[74429]:   </devices>
Oct 23 19:59:47 user nova-compute[74429]: </domain>
Oct 23 19:59:47 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T19:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1500447609',display_name='tempest-AttachSCSIVolumeTestJSON-server-1500447609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1500447609',id=5,image_ref='4173a61a-278c-4170-b621-3855a804c821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMElNpI/79AWwXCrpr3ouI39UOLj+tfq58hLhbQlMtCru40mV/P1eYpfckJvkrCV+OXCEK1t8HgU5Yrb7noQW2O5qgfpEOfkzFLJCZ7dTW78/8OvINBTi7iPT0V5fjr4gA==',key_name='tempest-keypair-929672768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e03ae34326de4865a98b9260d44c7913',ramdisk_id='',reservation_id='r-50oiffp0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4173a61a-278c-4170-b621-3855a804c821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1074995272',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1074995272-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a8f83b6a214c23ac062b7e0a59ab95',uuid=fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Converting VIF {"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG os_vif [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f78a166-5a91-511b-ba1c-69f5bae6cb31', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dea4302-ed, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dea4302-ed, col_values=(('qos', UUID('37629964-5370-481a-a1f1-fd41b24db6d3')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dea4302-ed, col_values=(('external_ids', {'iface-id': '1dea4302-ed87-4c99-9089-e02dae437431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:d1:e1', 'vm-uuid': 'fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:47 user nova-compute[74429]: INFO os_vif [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed')
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No BDM found with device name sda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No VIF found with MAC fa:16:3e:54:d1:e1, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 19:59:47 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Using config drive
Oct 23 19:59:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Creating config drive at /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.config
Oct 23 19:59:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkbx3by2w {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkbx3by2w" returned: 0 in 0.056s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-e37ca49f-d54f-4692-8985-e60aecac787b req-184f9eda-95cf-4b83-b063-6586b74e830b service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e37ca49f-d54f-4692-8985-e60aecac787b req-184f9eda-95cf-4b83-b063-6586b74e830b service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e37ca49f-d54f-4692-8985-e60aecac787b req-184f9eda-95cf-4b83-b063-6586b74e830b service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e37ca49f-d54f-4692-8985-e60aecac787b req-184f9eda-95cf-4b83-b063-6586b74e830b service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-e37ca49f-d54f-4692-8985-e60aecac787b req-184f9eda-95cf-4b83-b063-6586b74e830b service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:49 user nova-compute[74429]: WARNING nova.compute.manager [req-e37ca49f-d54f-4692-8985-e60aecac787b req-184f9eda-95cf-4b83-b063-6586b74e830b service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state None.
Oct 23 19:59:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-90e188ce-c7fc-4167-a0e5-62b887707e8e req-18d962ef-8086-4506-8040-ac3abf516f00 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-90e188ce-c7fc-4167-a0e5-62b887707e8e req-18d962ef-8086-4506-8040-ac3abf516f00 service nova] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-90e188ce-c7fc-4167-a0e5-62b887707e8e req-18d962ef-8086-4506-8040-ac3abf516f00 service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-90e188ce-c7fc-4167-a0e5-62b887707e8e req-18d962ef-8086-4506-8040-ac3abf516f00 service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-90e188ce-c7fc-4167-a0e5-62b887707e8e req-18d962ef-8086-4506-8040-ac3abf516f00 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] No waiting events found dispatching network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:49 user nova-compute[74429]: WARNING nova.compute.manager [req-90e188ce-c7fc-4167-a0e5-62b887707e8e req-18d962ef-8086-4506-8040-ac3abf516f00 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received unexpected event network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 for instance with vm_state active and task_state None.
Oct 23 19:59:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-2de115ac-ba90-4d3f-8419-5e86c0f6df1c req-e7858c4c-b661-41fe-9b41-89b92ceb3eb9 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2de115ac-ba90-4d3f-8419-5e86c0f6df1c req-e7858c4c-b661-41fe-9b41-89b92ceb3eb9 service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2de115ac-ba90-4d3f-8419-5e86c0f6df1c req-e7858c4c-b661-41fe-9b41-89b92ceb3eb9 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2de115ac-ba90-4d3f-8419-5e86c0f6df1c req-e7858c4c-b661-41fe-9b41-89b92ceb3eb9 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-2de115ac-ba90-4d3f-8419-5e86c0f6df1c req-e7858c4c-b661-41fe-9b41-89b92ceb3eb9 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:50 user nova-compute[74429]: WARNING nova.compute.manager [req-2de115ac-ba90-4d3f-8419-5e86c0f6df1c req-e7858c4c-b661-41fe-9b41-89b92ceb3eb9 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state building and task_state spawning.
Oct 23 19:59:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-9e35aec6-daa2-4b75-aaea-239295a748d8 req-b99c4fa0-e9f2-4e6f-97b0-c15709be700b service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9e35aec6-daa2-4b75-aaea-239295a748d8 req-b99c4fa0-e9f2-4e6f-97b0-c15709be700b service nova] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9e35aec6-daa2-4b75-aaea-239295a748d8 req-b99c4fa0-e9f2-4e6f-97b0-c15709be700b service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9e35aec6-daa2-4b75-aaea-239295a748d8 req-b99c4fa0-e9f2-4e6f-97b0-c15709be700b service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-9e35aec6-daa2-4b75-aaea-239295a748d8 req-b99c4fa0-e9f2-4e6f-97b0-c15709be700b service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] No waiting events found dispatching network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:51 user nova-compute[74429]: WARNING nova.compute.manager [req-9e35aec6-daa2-4b75-aaea-239295a748d8 req-b99c4fa0-e9f2-4e6f-97b0-c15709be700b service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received unexpected event network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 for instance with vm_state active and task_state None.
Oct 23 19:59:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-91131fe1-c3fd-4b97-8b40-648da64743ab req-59799cfa-0494-4276-ba27-66d2d93ecb6e service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91131fe1-c3fd-4b97-8b40-648da64743ab req-59799cfa-0494-4276-ba27-66d2d93ecb6e service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91131fe1-c3fd-4b97-8b40-648da64743ab req-59799cfa-0494-4276-ba27-66d2d93ecb6e service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91131fe1-c3fd-4b97-8b40-648da64743ab req-59799cfa-0494-4276-ba27-66d2d93ecb6e service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-91131fe1-c3fd-4b97-8b40-648da64743ab req-59799cfa-0494-4276-ba27-66d2d93ecb6e service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:52 user nova-compute[74429]: WARNING nova.compute.manager [req-91131fe1-c3fd-4b97-8b40-648da64743ab req-59799cfa-0494-4276-ba27-66d2d93ecb6e service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state building and task_state spawning.
Oct 23 19:59:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 19:59:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 19:59:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Instance spawned successfully.
Oct 23 19:59:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 19:59:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 19:59:53 user nova-compute[74429]: INFO nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Took 8.98 seconds to spawn the instance on the hypervisor.
Oct 23 19:59:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 19:59:53 user nova-compute[74429]: INFO nova.compute.manager [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Took 10.25 seconds to build instance.
Oct 23 19:59:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0288a2c-a37d-46f3-b98b-03afee8710dd tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.463s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 19:59:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 19:59:54 user nova-compute[74429]: INFO nova.compute.claims [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Claim successful on node user
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 19:59:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.policy [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e9d9096ebb5499e834d7f7156c7c578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5e323297d14a1fbb5e36ef9f4abd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 19:59:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Creating image(s)
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "/opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "/opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.225s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk 1073741824" returned: 0 in 0.077s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab7812dc-bfcf-4160-a72f-ebe8113f55a7 req-0b1aa204-5f39-460a-907c-4a713677cdb3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab7812dc-bfcf-4160-a72f-ebe8113f55a7 req-0b1aa204-5f39-460a-907c-4a713677cdb3 service nova] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab7812dc-bfcf-4160-a72f-ebe8113f55a7 req-0b1aa204-5f39-460a-907c-4a713677cdb3 service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab7812dc-bfcf-4160-a72f-ebe8113f55a7 req-0b1aa204-5f39-460a-907c-4a713677cdb3 service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab7812dc-bfcf-4160-a72f-ebe8113f55a7 req-0b1aa204-5f39-460a-907c-4a713677cdb3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] No waiting events found dispatching network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:56 user nova-compute[74429]: WARNING nova.compute.manager [req-ab7812dc-bfcf-4160-a72f-ebe8113f55a7 req-0b1aa204-5f39-460a-907c-4a713677cdb3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received unexpected event network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 for instance with vm_state active and task_state None.
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Successfully created port: 9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Cannot resize image /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Ensure instance console log exists: /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Successfully updated port: 9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquired lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-changed-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Refreshing instance network info cache due to event network-changed-9f4b61ff-cd8d-4d17-ba69-45c15de516b7. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] Acquiring lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updating instance_info_cache with network_info: [{"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Releasing lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Instance network_info: |[{"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] Acquired lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Refreshing network info cache for port 9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Start _get_guest_xml network_info=[{"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 19:59:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1054268787',display_name='tempest-VolumesAssistedSnapshotsTest-server-1054268787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1054268787',id=6,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP45RfA18JxQT3319hvF7dAg2JUJc9F8rsqSVyN4t3oCU0Aw7+cqVM9Zm7ULcw4d9s2Eo8L+MjUIja4wHCMhikb/nGMYI/xl7ZrmWQVK1vmqsYDkxnDy6OkYylJplxD5Wg==',key_name='tempest-keypair-1557373838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d5e323297d14a1fbb5e36ef9f4abd46',ramdisk_id='',reservation_id='r-v3c20j4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998593369',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998593369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e9d9096ebb5499e834d7f7156c7c578',uuid=a6d3a4b5-09f8-4c00-bec0-3793752ead25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Converting VIF {"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lazy-loading 'pci_devices' on Instance uuid a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] End _get_guest_xml xml=<domain type="kvm">
Oct 23 19:59:57 user nova-compute[74429]:   <uuid>a6d3a4b5-09f8-4c00-bec0-3793752ead25</uuid>
Oct 23 19:59:57 user nova-compute[74429]:   <name>instance-00000006</name>
Oct 23 19:59:57 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 19:59:57 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 19:59:57 user nova-compute[74429]:   <metadata>
Oct 23 19:59:57 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 19:59:57 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 19:59:57 user nova-compute[74429]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1054268787</nova:name>
Oct 23 19:59:57 user nova-compute[74429]:       <nova:creationTime>2023-10-23 19:59:57</nova:creationTime>
Oct 23 19:59:57 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 19:59:57 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 19:59:57 user nova-compute[74429]:       </nova:flavor>
Oct 23 19:59:57 user nova-compute[74429]:       <nova:owner>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:user uuid="9e9d9096ebb5499e834d7f7156c7c578">tempest-VolumesAssistedSnapshotsTest-998593369-project-member</nova:user>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:project uuid="2d5e323297d14a1fbb5e36ef9f4abd46">tempest-VolumesAssistedSnapshotsTest-998593369</nova:project>
Oct 23 19:59:57 user nova-compute[74429]:       </nova:owner>
Oct 23 19:59:57 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 19:59:57 user nova-compute[74429]:       <nova:ports>
Oct 23 19:59:57 user nova-compute[74429]:         <nova:port uuid="9f4b61ff-cd8d-4d17-ba69-45c15de516b7">
Oct 23 19:59:57 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 19:59:57 user nova-compute[74429]:         </nova:port>
Oct 23 19:59:57 user nova-compute[74429]:       </nova:ports>
Oct 23 19:59:57 user nova-compute[74429]:     </nova:instance>
Oct 23 19:59:57 user nova-compute[74429]:   </metadata>
Oct 23 19:59:57 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 19:59:57 user nova-compute[74429]:     <system>
Oct 23 19:59:57 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 19:59:57 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 19:59:57 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 19:59:57 user nova-compute[74429]:       <entry name="serial">a6d3a4b5-09f8-4c00-bec0-3793752ead25</entry>
Oct 23 19:59:57 user nova-compute[74429]:       <entry name="uuid">a6d3a4b5-09f8-4c00-bec0-3793752ead25</entry>
Oct 23 19:59:57 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 19:59:57 user nova-compute[74429]:     </system>
Oct 23 19:59:57 user nova-compute[74429]:   </sysinfo>
Oct 23 19:59:57 user nova-compute[74429]:   <os>
Oct 23 19:59:57 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 19:59:57 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 19:59:57 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 19:59:57 user nova-compute[74429]:   </os>
Oct 23 19:59:57 user nova-compute[74429]:   <features>
Oct 23 19:59:57 user nova-compute[74429]:     <acpi/>
Oct 23 19:59:57 user nova-compute[74429]:     <apic/>
Oct 23 19:59:57 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 19:59:57 user nova-compute[74429]:   </features>
Oct 23 19:59:57 user nova-compute[74429]:   <clock offset="utc">
Oct 23 19:59:57 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 19:59:57 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 19:59:57 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 19:59:57 user nova-compute[74429]:   </clock>
Oct 23 19:59:57 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 19:59:57 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 19:59:57 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 19:59:57 user nova-compute[74429]:   </cpu>
Oct 23 19:59:57 user nova-compute[74429]:   <devices>
Oct 23 19:59:57 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 19:59:57 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 19:59:57 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk"/>
Oct 23 19:59:57 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 19:59:57 user nova-compute[74429]:     </disk>
Oct 23 19:59:57 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 19:59:57 user nova-compute[74429]:       <mac address="fa:16:3e:6d:50:3b"/>
Oct 23 19:59:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:57 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 19:59:57 user nova-compute[74429]:       <target dev="tap9f4b61ff-cd"/>
Oct 23 19:59:57 user nova-compute[74429]:     </interface>
Oct 23 19:59:57 user nova-compute[74429]:     <serial type="pty">
Oct 23 19:59:57 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/console.log" append="off"/>
Oct 23 19:59:57 user nova-compute[74429]:     </serial>
Oct 23 19:59:57 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 19:59:57 user nova-compute[74429]:     <video>
Oct 23 19:59:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 19:59:57 user nova-compute[74429]:     </video>
Oct 23 19:59:57 user nova-compute[74429]:     <rng model="virtio">
Oct 23 19:59:57 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 19:59:57 user nova-compute[74429]:     </rng>
Oct 23 19:59:57 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 19:59:57 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 19:59:57 user nova-compute[74429]:       <stats period="10"/>
Oct 23 19:59:57 user nova-compute[74429]:     </memballoon>
Oct 23 19:59:57 user nova-compute[74429]:   </devices>
Oct 23 19:59:57 user nova-compute[74429]: </domain>
Oct 23 19:59:57 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1054268787',display_name='tempest-VolumesAssistedSnapshotsTest-server-1054268787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1054268787',id=6,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP45RfA18JxQT3319hvF7dAg2JUJc9F8rsqSVyN4t3oCU0Aw7+cqVM9Zm7ULcw4d9s2Eo8L+MjUIja4wHCMhikb/nGMYI/xl7ZrmWQVK1vmqsYDkxnDy6OkYylJplxD5Wg==',key_name='tempest-keypair-1557373838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d5e323297d14a1fbb5e36ef9f4abd46',ramdisk_id='',reservation_id='r-v3c20j4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998593369',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998593369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T19:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e9d9096ebb5499e834d7f7156c7c578',uuid=a6d3a4b5-09f8-4c00-bec0-3793752ead25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Converting VIF {"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG os_vif [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7faec54c-18dd-5489-9e2a-dca536dd88e5', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f4b61ff-cd, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f4b61ff-cd, col_values=(('qos', UUID('a9638ec8-91eb-445c-85de-a5958c2d3ae6')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f4b61ff-cd, col_values=(('external_ids', {'iface-id': '9f4b61ff-cd8d-4d17-ba69-45c15de516b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:50:3b', 'vm-uuid': 'a6d3a4b5-09f8-4c00-bec0-3793752ead25'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:57 user nova-compute[74429]: INFO os_vif [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd')
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 19:59:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] No VIF found with MAC fa:16:3e:6d:50:3b, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.network.neutron [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updated VIF entry in instance network info cache for port 9f4b61ff-cd8d-4d17-ba69-45c15de516b7. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.network.neutron [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updating instance_info_cache with network_info: [{"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e3673468-ceb8-45b6-9f17-76b77a9d4ae3 req-46fbd7f2-7489-401a-9caa-70bbefc69d0d service nova] Releasing lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] No waiting events found dispatching network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:58 user nova-compute[74429]: WARNING nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received unexpected event network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 for instance with vm_state active and task_state None.
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:58 user nova-compute[74429]: WARNING nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state None.
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 19:59:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 19:59:58 user nova-compute[74429]: WARNING nova.compute.manager [req-179ebd34-21c7-4cb2-bdf4-754971f899cb req-c990d4e9-fdfc-4961-9bce-283409d384fd service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state None.
Oct 23 19:59:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 19:59:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:00:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Instance spawned successfully.
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:02 user nova-compute[74429]: INFO nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:02 user nova-compute[74429]: INFO nova.compute.manager [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Took 7.68 seconds to build instance.
Oct 23 20:00:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0eae1408-4dec-47c8-a32a-48efaf27d176 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.808s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-9260ef2d-c483-4d7d-91fd-ba87bd59aec4 req-72c4e92f-7b2b-434f-9c3d-b01e730b9e22 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9260ef2d-c483-4d7d-91fd-ba87bd59aec4 req-72c4e92f-7b2b-434f-9c3d-b01e730b9e22 service nova] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9260ef2d-c483-4d7d-91fd-ba87bd59aec4 req-72c4e92f-7b2b-434f-9c3d-b01e730b9e22 service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9260ef2d-c483-4d7d-91fd-ba87bd59aec4 req-72c4e92f-7b2b-434f-9c3d-b01e730b9e22 service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-9260ef2d-c483-4d7d-91fd-ba87bd59aec4 req-72c4e92f-7b2b-434f-9c3d-b01e730b9e22 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] No waiting events found dispatching network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:02 user nova-compute[74429]: WARNING nova.compute.manager [req-9260ef2d-c483-4d7d-91fd-ba87bd59aec4 req-72c4e92f-7b2b-434f-9c3d-b01e730b9e22 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received unexpected event network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 for instance with vm_state active and task_state None.
Oct 23 20:00:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-c75bc80d-d52e-4bfd-a922-e0a5cc145bb1 req-3935e9f6-7c56-42d2-b773-c3ed5484cc54 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c75bc80d-d52e-4bfd-a922-e0a5cc145bb1 req-3935e9f6-7c56-42d2-b773-c3ed5484cc54 service nova] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c75bc80d-d52e-4bfd-a922-e0a5cc145bb1 req-3935e9f6-7c56-42d2-b773-c3ed5484cc54 service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c75bc80d-d52e-4bfd-a922-e0a5cc145bb1 req-3935e9f6-7c56-42d2-b773-c3ed5484cc54 service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-c75bc80d-d52e-4bfd-a922-e0a5cc145bb1 req-3935e9f6-7c56-42d2-b773-c3ed5484cc54 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] No waiting events found dispatching network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:04 user nova-compute[74429]: WARNING nova.compute.manager [req-c75bc80d-d52e-4bfd-a922-e0a5cc145bb1 req-3935e9f6-7c56-42d2-b773-c3ed5484cc54 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received unexpected event network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 for instance with vm_state active and task_state None.
Oct 23 20:00:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:00:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:00:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:00:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:00:09 user nova-compute[74429]: INFO nova.compute.claims [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Claim successful on node user
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:00:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.policy [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4e3fa8f8f134ad7b01e1c391e8d6b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7e46063e9946b5b4f868cd9205a0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:00:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Creating image(s)
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "/opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "/opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.207s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk 1073741824" returned: 0 in 0.087s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Successfully created port: 4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Cannot resize image /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Ensure instance console log exists: /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Skipping network cache update for instance because it is Building. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:00:11 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid dc41e78e-050f-429e-b0b9-f4473a07c2c7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updating instance_info_cache with network_info: [{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Successfully updated port: 4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquired lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-changed-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Refreshing instance network info cache due to event network-changed-4157a0b7-da9e-4379-b63e-8d7305dbf6b1. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:00:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] Acquiring lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.neutron [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.neutron [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updating instance_info_cache with network_info: [{"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Releasing lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Instance network_info: |[{"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] Acquired lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Refreshing network info cache for port 4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Start _get_guest_xml network_info=[{"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:00:13 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:13 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1962566548',display_name='tempest-TestVolumeSwap-server-1962566548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1962566548',id=7,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCoIclRbGzWX92UjS8C7mra1IvqMtlDIOvYIQf4dfS+dXv1JQMeAFrQsX4AdtWmDsXOXfb5PknGOTLGNgv/LNDoZ0keTNEjkS6p9+m+p5qjeuyaKW4+ZkAR9woCj7URyA==',key_name='tempest-keypair-1036448723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b7e46063e9946b5b4f868cd9205a0b2',ramdisk_id='',reservation_id='r-tq9nyk33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1162461156',owner_user_name='tempest-TestVolumeSwap-1162461156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4e3fa8f8f134ad7b01e1c391e8d6b9a',uuid=1a41ae88-9f6c-47c4-a7d5-e2501228b313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Converting VIF {"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:00:13 user nova-compute[74429]:   <uuid>1a41ae88-9f6c-47c4-a7d5-e2501228b313</uuid>
Oct 23 20:00:13 user nova-compute[74429]:   <name>instance-00000007</name>
Oct 23 20:00:13 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:00:13 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:00:13 user nova-compute[74429]:   <metadata>
Oct 23 20:00:13 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:00:13 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:00:13 user nova-compute[74429]:       <nova:name>tempest-TestVolumeSwap-server-1962566548</nova:name>
Oct 23 20:00:13 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:00:13</nova:creationTime>
Oct 23 20:00:13 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:00:13 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:00:13 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:00:13 user nova-compute[74429]:       <nova:owner>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:user uuid="f4e3fa8f8f134ad7b01e1c391e8d6b9a">tempest-TestVolumeSwap-1162461156-project-member</nova:user>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:project uuid="8b7e46063e9946b5b4f868cd9205a0b2">tempest-TestVolumeSwap-1162461156</nova:project>
Oct 23 20:00:13 user nova-compute[74429]:       </nova:owner>
Oct 23 20:00:13 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:00:13 user nova-compute[74429]:       <nova:ports>
Oct 23 20:00:13 user nova-compute[74429]:         <nova:port uuid="4157a0b7-da9e-4379-b63e-8d7305dbf6b1">
Oct 23 20:00:13 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 20:00:13 user nova-compute[74429]:         </nova:port>
Oct 23 20:00:13 user nova-compute[74429]:       </nova:ports>
Oct 23 20:00:13 user nova-compute[74429]:     </nova:instance>
Oct 23 20:00:13 user nova-compute[74429]:   </metadata>
Oct 23 20:00:13 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:00:13 user nova-compute[74429]:     <system>
Oct 23 20:00:13 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:00:13 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:00:13 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:00:13 user nova-compute[74429]:       <entry name="serial">1a41ae88-9f6c-47c4-a7d5-e2501228b313</entry>
Oct 23 20:00:13 user nova-compute[74429]:       <entry name="uuid">1a41ae88-9f6c-47c4-a7d5-e2501228b313</entry>
Oct 23 20:00:13 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:00:13 user nova-compute[74429]:     </system>
Oct 23 20:00:13 user nova-compute[74429]:   </sysinfo>
Oct 23 20:00:13 user nova-compute[74429]:   <os>
Oct 23 20:00:13 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:00:13 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:00:13 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:00:13 user nova-compute[74429]:   </os>
Oct 23 20:00:13 user nova-compute[74429]:   <features>
Oct 23 20:00:13 user nova-compute[74429]:     <acpi/>
Oct 23 20:00:13 user nova-compute[74429]:     <apic/>
Oct 23 20:00:13 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:00:13 user nova-compute[74429]:   </features>
Oct 23 20:00:13 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:00:13 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:00:13 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:00:13 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:00:13 user nova-compute[74429]:   </clock>
Oct 23 20:00:13 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:00:13 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:00:13 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:00:13 user nova-compute[74429]:   </cpu>
Oct 23 20:00:13 user nova-compute[74429]:   <devices>
Oct 23 20:00:13 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:00:13 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:00:13 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk"/>
Oct 23 20:00:13 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:00:13 user nova-compute[74429]:     </disk>
Oct 23 20:00:13 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:00:13 user nova-compute[74429]:       <mac address="fa:16:3e:c3:27:8e"/>
Oct 23 20:00:13 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:00:13 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:00:13 user nova-compute[74429]:       <target dev="tap4157a0b7-da"/>
Oct 23 20:00:13 user nova-compute[74429]:     </interface>
Oct 23 20:00:13 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:00:13 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/console.log" append="off"/>
Oct 23 20:00:13 user nova-compute[74429]:     </serial>
Oct 23 20:00:13 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:00:13 user nova-compute[74429]:     <video>
Oct 23 20:00:13 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:00:13 user nova-compute[74429]:     </video>
Oct 23 20:00:13 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:00:13 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:00:13 user nova-compute[74429]:     </rng>
Oct 23 20:00:13 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:00:13 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:00:13 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:00:13 user nova-compute[74429]:     </memballoon>
Oct 23 20:00:13 user nova-compute[74429]:   </devices>
Oct 23 20:00:13 user nova-compute[74429]: </domain>
Oct 23 20:00:13 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1962566548',display_name='tempest-TestVolumeSwap-server-1962566548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1962566548',id=7,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCoIclRbGzWX92UjS8C7mra1IvqMtlDIOvYIQf4dfS+dXv1JQMeAFrQsX4AdtWmDsXOXfb5PknGOTLGNgv/LNDoZ0keTNEjkS6p9+m+p5qjeuyaKW4+ZkAR9woCj7URyA==',key_name='tempest-keypair-1036448723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b7e46063e9946b5b4f868cd9205a0b2',ramdisk_id='',reservation_id='r-tq9nyk33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1162461156',owner_user_name='tempest-TestVolumeSwap-1162461156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4e3fa8f8f134ad7b01e1c391e8d6b9a',uuid=1a41ae88-9f6c-47c4-a7d5-e2501228b313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Converting VIF {"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG os_vif [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40236ac8-3011-5650-900c-2cbe71ca6acd', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4157a0b7-da, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4157a0b7-da, col_values=(('qos', UUID('88c5b215-e06e-4808-a7f2-9378858835a5')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4157a0b7-da, col_values=(('external_ids', {'iface-id': '4157a0b7-da9e-4379-b63e-8d7305dbf6b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:27:8e', 'vm-uuid': '1a41ae88-9f6c-47c4-a7d5-e2501228b313'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:13 user nova-compute[74429]: INFO os_vif [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da')
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] No VIF found with MAC fa:16:3e:c3:27:8e, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updated VIF entry in instance network info cache for port 4157a0b7-da9e-4379-b63e-8d7305dbf6b1. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updating instance_info_cache with network_info: [{"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e21b70a-bd7a-4de2-a63a-cdf8cf75ddb9 req-e13685f3-b53c-41ec-a52f-2682c7c08c94 service nova] Releasing lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-897215d7-4d21-4b2a-8b5d-9b85b8d6d043 req-6830f1d1-b6be-4a23-95f0-dc41fbc399ab service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-897215d7-4d21-4b2a-8b5d-9b85b8d6d043 req-6830f1d1-b6be-4a23-95f0-dc41fbc399ab service nova] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-897215d7-4d21-4b2a-8b5d-9b85b8d6d043 req-6830f1d1-b6be-4a23-95f0-dc41fbc399ab service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-897215d7-4d21-4b2a-8b5d-9b85b8d6d043 req-6830f1d1-b6be-4a23-95f0-dc41fbc399ab service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-897215d7-4d21-4b2a-8b5d-9b85b8d6d043 req-6830f1d1-b6be-4a23-95f0-dc41fbc399ab service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] No waiting events found dispatching network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:15 user nova-compute[74429]: WARNING nova.compute.manager [req-897215d7-4d21-4b2a-8b5d-9b85b8d6d043 req-6830f1d1-b6be-4a23-95f0-dc41fbc399ab service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received unexpected event network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 for instance with vm_state building and task_state spawning.
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:16 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:16 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=25.79452896118164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d1572158-f516-4454-96ce-4a5e720b4041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:00:16 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.881s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-ce8acedc-bd90-4bcf-9289-4362afc8d5b7 req-16f62e7d-1f59-4f9b-b0e5-de2c88983d2f service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ce8acedc-bd90-4bcf-9289-4362afc8d5b7 req-16f62e7d-1f59-4f9b-b0e5-de2c88983d2f service nova] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ce8acedc-bd90-4bcf-9289-4362afc8d5b7 req-16f62e7d-1f59-4f9b-b0e5-de2c88983d2f service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ce8acedc-bd90-4bcf-9289-4362afc8d5b7 req-16f62e7d-1f59-4f9b-b0e5-de2c88983d2f service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-ce8acedc-bd90-4bcf-9289-4362afc8d5b7 req-16f62e7d-1f59-4f9b-b0e5-de2c88983d2f service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] No waiting events found dispatching network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:17 user nova-compute[74429]: WARNING nova.compute.manager [req-ce8acedc-bd90-4bcf-9289-4362afc8d5b7 req-16f62e7d-1f59-4f9b-b0e5-de2c88983d2f service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received unexpected event network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 for instance with vm_state building and task_state spawning.
Oct 23 20:00:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:00:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Instance spawned successfully.
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:17 user nova-compute[74429]: INFO nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Took 7.20 seconds to spawn the instance on the hypervisor.
Oct 23 20:00:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:00:17 user nova-compute[74429]: INFO nova.compute.manager [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Took 8.11 seconds to build instance.
Oct 23 20:00:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84959cf5-6c5a-4cb1-95cf-ba6898f8d1c0 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.280s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:00:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:00:30 user nova-compute[74429]: INFO nova.compute.claims [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Claim successful on node user
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:00:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:00:30 user nova-compute[74429]: DEBUG nova.policy [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb4f293bc56648d1a664c7487f868607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b589e45483454d7a90358486b8226198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:00:30 user nova-compute[74429]: INFO nova.virt.block_device [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Booting with volume e05e591c-4315-4349-8f87-450ba1215d64 at /dev/vda
Oct 23 20:00:30 user nova-compute[74429]: DEBUG os_brick.utils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:00:30 user nova-compute[74429]: INFO oslo.privsep.daemon [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpyj065n8z/privsep.sock']
Oct 23 20:00:30 user sudo[85261]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpyj065n8z/privsep.sock
Oct 23 20:00:30 user sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 20:00:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Successfully created port: 8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Successfully updated port: 8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquired lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-changed-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Refreshing instance network info cache due to event network-changed-8b8176bc-f9da-4a7a-a3c1-14a69c90959c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] Acquiring lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:32 user sudo[85261]: pam_unix(sudo:session): session closed for user root
Oct 23 20:00:32 user nova-compute[74429]: INFO oslo.privsep.daemon [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Spawned new privsep daemon via rootwrap
Oct 23 20:00:32 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 20:00:32 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 20:00:32 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 23 20:00:32 user nova-compute[74429]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85343
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1f4b0-a27e-4d23-8e40-aff887ebfb32]: (2,) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea665e-dee4-4254-9054-f031c197c8fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:32 user nova-compute[74429]: WARNING os_brick.initiator.connectors.nvmeof [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f0f774-e1e0-433e-b6c1-623d8f4ed7b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe40c26-6d39-4707-bdab-4403955baadc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c47edf-3a9c-424f-bfb9-65576073bc0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:00:32 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb36f7-7687-4783-bae8-fb3ca3135b04]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG os_brick.utils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== get_connector_properties: return (1972ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updating existing volume attachment record: 00b2db21-2d97-4093-a516-f01394322580 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updating instance_info_cache with network_info: [{"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Releasing lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance network_info: |[{"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] Acquired lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Refreshing network info cache for port 8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:00:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updated VIF entry in instance network info cache for port 8b8176bc-f9da-4a7a-a3c1-14a69c90959c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:00:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updating instance_info_cache with network_info: [{"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de8a89b9-a7ab-48c4-8004-a5061bcfbc51 req-e258011f-cbe9-4e6e-9e5c-3eb7eaeb78b2 service nova] Releasing lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:00:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Creating image(s)
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Ensure instance console log exists: /opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Start _get_guest_xml network_info=[{"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '00b2db21-2d97-4093-a516-f01394322580', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18e01426-64cf-4ca4-90b6-58e17f80242c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e05e591c-4315-4349-8f87-450ba1215d64', 'serial': 'e05e591c-4315-4349-8f87-450ba1215d64'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:00:51 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:51 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connector [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Factory for ISCSI on None {{(pid=74429) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:00:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:00:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:00:51 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b05b67-3c0a-4082-bbf5-c834d5d3cceb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:00:51 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb83a63-3ad9-446a-b0a5-8fd78ec2000d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64] added
Oct 23 20:00:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3df822-0f5b-4239-8201-f5bea60a459c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[570faadd-c465-4208-ad88-d35a89092fc8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRJdQBFn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRJdQBFn" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b76742-166e-4e56-8987-487718bb479a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRJdQBFn'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d1180a-4bbf-4bb5-b049-d17f9149fac3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9788f23-1551-45b4-9988-cf96e8961e19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:00:51 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:00:51 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:00:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:00:51 user nova-compute[74429]: 
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b6ca5-7954-4089-b121-7fa00d7db5d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]
Oct 23 20:00:51 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.
Oct 23 20:00:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f73c06-6ef2-463d-a98c-cdcfd0ede532]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[560f0d1f-63d4-4baf-8123-f9bacd6fe720]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:00:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:00:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e168c396-90b6-4c01-9c8a-7503013b9d80]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:00:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23437616666643333', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437616666643333', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-21309619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-21309619',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYaIxZ7haGHQMD2Sc8iBoGdZU3kvelcOBgu+qFikPLl+VRRGeDnKWY3kG8gozWbDIfd0wVL3Fo7n6yEXtY6YFq0e1EKglNJL7sWOSRs01CeH9d99XcJG2Pv5Mb2uI6tQ==',key_name='tempest-keypair-40106845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b589e45483454d7a90358486b8226198',ramdisk_id='',reservation_id='r-c80lshri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1521560130',owner_user_name='tempest-ServerActionsV293TestJSON-1521560130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4f293bc56648d1a664c7487f868607',uuid=18e01426-64cf-4ca4-90b6-58e17f80242c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converting VIF {"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lazy-loading 'pci_devices' on Instance uuid 18e01426-64cf-4ca4-90b6-58e17f80242c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:00:52 user nova-compute[74429]:   <uuid>18e01426-64cf-4ca4-90b6-58e17f80242c</uuid>
Oct 23 20:00:52 user nova-compute[74429]:   <name>instance-00000008</name>
Oct 23 20:00:52 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:00:52 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:00:52 user nova-compute[74429]:   <metadata>
Oct 23 20:00:52 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:00:52 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:00:52 user nova-compute[74429]:       <nova:name>tempest-ServerActionsV293TestJSON-server-21309619</nova:name>
Oct 23 20:00:52 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:00:51</nova:creationTime>
Oct 23 20:00:52 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:00:52 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:00:52 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:00:52 user nova-compute[74429]:       <nova:owner>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:user uuid="fb4f293bc56648d1a664c7487f868607">tempest-ServerActionsV293TestJSON-1521560130-project-member</nova:user>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:project uuid="b589e45483454d7a90358486b8226198">tempest-ServerActionsV293TestJSON-1521560130</nova:project>
Oct 23 20:00:52 user nova-compute[74429]:       </nova:owner>
Oct 23 20:00:52 user nova-compute[74429]:       <nova:ports>
Oct 23 20:00:52 user nova-compute[74429]:         <nova:port uuid="8b8176bc-f9da-4a7a-a3c1-14a69c90959c">
Oct 23 20:00:52 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:00:52 user nova-compute[74429]:         </nova:port>
Oct 23 20:00:52 user nova-compute[74429]:       </nova:ports>
Oct 23 20:00:52 user nova-compute[74429]:     </nova:instance>
Oct 23 20:00:52 user nova-compute[74429]:   </metadata>
Oct 23 20:00:52 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:00:52 user nova-compute[74429]:     <system>
Oct 23 20:00:52 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:00:52 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:00:52 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:00:52 user nova-compute[74429]:       <entry name="serial">18e01426-64cf-4ca4-90b6-58e17f80242c</entry>
Oct 23 20:00:52 user nova-compute[74429]:       <entry name="uuid">18e01426-64cf-4ca4-90b6-58e17f80242c</entry>
Oct 23 20:00:52 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:00:52 user nova-compute[74429]:     </system>
Oct 23 20:00:52 user nova-compute[74429]:   </sysinfo>
Oct 23 20:00:52 user nova-compute[74429]:   <os>
Oct 23 20:00:52 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:00:52 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:00:52 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:00:52 user nova-compute[74429]:   </os>
Oct 23 20:00:52 user nova-compute[74429]:   <features>
Oct 23 20:00:52 user nova-compute[74429]:     <acpi/>
Oct 23 20:00:52 user nova-compute[74429]:     <apic/>
Oct 23 20:00:52 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:00:52 user nova-compute[74429]:   </features>
Oct 23 20:00:52 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:00:52 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:00:52 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:00:52 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:00:52 user nova-compute[74429]:   </clock>
Oct 23 20:00:52 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:00:52 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:00:52 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:00:52 user nova-compute[74429]:   </cpu>
Oct 23 20:00:52 user nova-compute[74429]:   <devices>
Oct 23 20:00:52 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:00:52 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:00:52 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:00:52 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:00:52 user nova-compute[74429]:       <serial>e05e591c-4315-4349-8f87-450ba1215d64</serial>
Oct 23 20:00:52 user nova-compute[74429]:     </disk>
Oct 23 20:00:52 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:00:52 user nova-compute[74429]:       <mac address="fa:16:3e:1b:15:d1"/>
Oct 23 20:00:52 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:00:52 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:00:52 user nova-compute[74429]:       <target dev="tap8b8176bc-f9"/>
Oct 23 20:00:52 user nova-compute[74429]:     </interface>
Oct 23 20:00:52 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:00:52 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c/console.log" append="off"/>
Oct 23 20:00:52 user nova-compute[74429]:     </serial>
Oct 23 20:00:52 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:00:52 user nova-compute[74429]:     <video>
Oct 23 20:00:52 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:00:52 user nova-compute[74429]:     </video>
Oct 23 20:00:52 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:00:52 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:00:52 user nova-compute[74429]:     </rng>
Oct 23 20:00:52 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:00:52 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:00:52 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:00:52 user nova-compute[74429]:     </memballoon>
Oct 23 20:00:52 user nova-compute[74429]:   </devices>
Oct 23 20:00:52 user nova-compute[74429]: </domain>
Oct 23 20:00:52 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-21309619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-21309619',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYaIxZ7haGHQMD2Sc8iBoGdZU3kvelcOBgu+qFikPLl+VRRGeDnKWY3kG8gozWbDIfd0wVL3Fo7n6yEXtY6YFq0e1EKglNJL7sWOSRs01CeH9d99XcJG2Pv5Mb2uI6tQ==',key_name='tempest-keypair-40106845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b589e45483454d7a90358486b8226198',ramdisk_id='',reservation_id='r-c80lshri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1521560130',owner_user_name='tempest-ServerActionsV293TestJSON-1521560130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4f293bc56648d1a664c7487f868607',uuid=18e01426-64cf-4ca4-90b6-58e17f80242c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converting VIF {"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG os_vif [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04d863a5-e9fe-5563-bcde-756c544b3fe5', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8176bc-f9, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b8176bc-f9, col_values=(('qos', UUID('ec4f7928-987b-4d4b-bd6d-31a84e94d4fb')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b8176bc-f9, col_values=(('external_ids', {'iface-id': '8b8176bc-f9da-4a7a-a3c1-14a69c90959c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:15:d1', 'vm-uuid': '18e01426-64cf-4ca4-90b6-58e17f80242c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:52 user nova-compute[74429]: INFO os_vif [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9')
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:00:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] No VIF found with MAC fa:16:3e:1b:15:d1, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa09b565-293c-4bd1-bf44-7574923699a3 req-435561db-639f-4f3b-b264-bb4e638fa3ad service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa09b565-293c-4bd1-bf44-7574923699a3 req-435561db-639f-4f3b-b264-bb4e638fa3ad service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa09b565-293c-4bd1-bf44-7574923699a3 req-435561db-639f-4f3b-b264-bb4e638fa3ad service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa09b565-293c-4bd1-bf44-7574923699a3 req-435561db-639f-4f3b-b264-bb4e638fa3ad service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa09b565-293c-4bd1-bf44-7574923699a3 req-435561db-639f-4f3b-b264-bb4e638fa3ad service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:54 user nova-compute[74429]: WARNING nova.compute.manager [req-aa09b565-293c-4bd1-bf44-7574923699a3 req-435561db-639f-4f3b-b264-bb4e638fa3ad service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state building and task_state spawning.
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:00:55 user nova-compute[74429]: INFO nova.compute.claims [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Claim successful on node user
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:00:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.policy [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c600566c5fef49bdabb57bc0f8233049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74dd7809fa6b4cf185a02e8ffc0f5439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:00:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Creating image(s)
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "/opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "/opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "/opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk 1073741824" returned: 0 in 0.062s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:00:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance spawned successfully.
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Successfully created port: 3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:00:56 user nova-compute[74429]: INFO nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.230s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:00:56 user nova-compute[74429]: INFO nova.compute.manager [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Took 26.65 seconds to build instance.
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0e08e9b8-6bb6-42b8-a37b-5962efcf42d5 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.798s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Cannot resize image /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Ensure instance console log exists: /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-587c565c-a74f-4047-8776-30e4575da085 req-1a2c204c-a53c-4e59-908f-904ad75e051d service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-587c565c-a74f-4047-8776-30e4575da085 req-1a2c204c-a53c-4e59-908f-904ad75e051d service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-587c565c-a74f-4047-8776-30e4575da085 req-1a2c204c-a53c-4e59-908f-904ad75e051d service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-587c565c-a74f-4047-8776-30e4575da085 req-1a2c204c-a53c-4e59-908f-904ad75e051d service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-587c565c-a74f-4047-8776-30e4575da085 req-1a2c204c-a53c-4e59-908f-904ad75e051d service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:56 user nova-compute[74429]: WARNING nova.compute.manager [req-587c565c-a74f-4047-8776-30e4575da085 req-1a2c204c-a53c-4e59-908f-904ad75e051d service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state active and task_state None.
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Successfully updated port: 3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquired lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received event network-changed-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Refreshing instance network info cache due to event network-changed-3787f163-ec13-4032-a8b6-22b3ba8266d0. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] Acquiring lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating instance_info_cache with network_info: [{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Releasing lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Instance network_info: |[{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] Acquired lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Refreshing network info cache for port 3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Start _get_guest_xml network_info=[{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:00:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1404241175',display_name='tempest-TestStampPattern-server-1404241175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1404241175',id=9,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UEGx8zY0R42EfuCAeeZ9GcoX+fKO6uxcXyPESeKU8tZbyBeoCemxWqY8zrVqk2YCKJ1oYbgTDCWR7zsf+i7gwTf2tIe3iSvwUxABB+ro2StTbFJpgMxD50UDdJ16VlQ==',key_name='tempest-TestStampPattern-310945430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74dd7809fa6b4cf185a02e8ffc0f5439',ramdisk_id='',reservation_id='r-1b5jz0ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617962097',owner_user_name='tempest-TestStampPattern-1617962097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:00:56Z,user_data=None,user_id='c600566c5fef49bdabb57bc0f8233049',uuid=60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converting VIF {"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'pci_devices' on Instance uuid 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:00:57 user nova-compute[74429]:   <uuid>60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853</uuid>
Oct 23 20:00:57 user nova-compute[74429]:   <name>instance-00000009</name>
Oct 23 20:00:57 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:00:57 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:00:57 user nova-compute[74429]:   <metadata>
Oct 23 20:00:57 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:00:57 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:00:57 user nova-compute[74429]:       <nova:name>tempest-TestStampPattern-server-1404241175</nova:name>
Oct 23 20:00:57 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:00:57</nova:creationTime>
Oct 23 20:00:57 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:00:57 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:00:57 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:00:57 user nova-compute[74429]:       <nova:owner>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:user uuid="c600566c5fef49bdabb57bc0f8233049">tempest-TestStampPattern-1617962097-project-member</nova:user>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:project uuid="74dd7809fa6b4cf185a02e8ffc0f5439">tempest-TestStampPattern-1617962097</nova:project>
Oct 23 20:00:57 user nova-compute[74429]:       </nova:owner>
Oct 23 20:00:57 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:00:57 user nova-compute[74429]:       <nova:ports>
Oct 23 20:00:57 user nova-compute[74429]:         <nova:port uuid="3787f163-ec13-4032-a8b6-22b3ba8266d0">
Oct 23 20:00:57 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:00:57 user nova-compute[74429]:         </nova:port>
Oct 23 20:00:57 user nova-compute[74429]:       </nova:ports>
Oct 23 20:00:57 user nova-compute[74429]:     </nova:instance>
Oct 23 20:00:57 user nova-compute[74429]:   </metadata>
Oct 23 20:00:57 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:00:57 user nova-compute[74429]:     <system>
Oct 23 20:00:57 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:00:57 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:00:57 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:00:57 user nova-compute[74429]:       <entry name="serial">60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853</entry>
Oct 23 20:00:57 user nova-compute[74429]:       <entry name="uuid">60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853</entry>
Oct 23 20:00:57 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:00:57 user nova-compute[74429]:     </system>
Oct 23 20:00:57 user nova-compute[74429]:   </sysinfo>
Oct 23 20:00:57 user nova-compute[74429]:   <os>
Oct 23 20:00:57 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:00:57 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:00:57 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:00:57 user nova-compute[74429]:   </os>
Oct 23 20:00:57 user nova-compute[74429]:   <features>
Oct 23 20:00:57 user nova-compute[74429]:     <acpi/>
Oct 23 20:00:57 user nova-compute[74429]:     <apic/>
Oct 23 20:00:57 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:00:57 user nova-compute[74429]:   </features>
Oct 23 20:00:57 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:00:57 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:00:57 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:00:57 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:00:57 user nova-compute[74429]:   </clock>
Oct 23 20:00:57 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:00:57 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:00:57 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:00:57 user nova-compute[74429]:   </cpu>
Oct 23 20:00:57 user nova-compute[74429]:   <devices>
Oct 23 20:00:57 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:00:57 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:00:57 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk"/>
Oct 23 20:00:57 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:00:57 user nova-compute[74429]:     </disk>
Oct 23 20:00:57 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:00:57 user nova-compute[74429]:       <mac address="fa:16:3e:be:cb:dc"/>
Oct 23 20:00:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:00:57 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:00:57 user nova-compute[74429]:       <target dev="tap3787f163-ec"/>
Oct 23 20:00:57 user nova-compute[74429]:     </interface>
Oct 23 20:00:57 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:00:57 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/console.log" append="off"/>
Oct 23 20:00:57 user nova-compute[74429]:     </serial>
Oct 23 20:00:57 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:00:57 user nova-compute[74429]:     <video>
Oct 23 20:00:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:00:57 user nova-compute[74429]:     </video>
Oct 23 20:00:57 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:00:57 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:00:57 user nova-compute[74429]:     </rng>
Oct 23 20:00:57 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:00:57 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:00:57 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:00:57 user nova-compute[74429]:     </memballoon>
Oct 23 20:00:57 user nova-compute[74429]:   </devices>
Oct 23 20:00:57 user nova-compute[74429]: </domain>
Oct 23 20:00:57 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1404241175',display_name='tempest-TestStampPattern-server-1404241175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1404241175',id=9,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UEGx8zY0R42EfuCAeeZ9GcoX+fKO6uxcXyPESeKU8tZbyBeoCemxWqY8zrVqk2YCKJ1oYbgTDCWR7zsf+i7gwTf2tIe3iSvwUxABB+ro2StTbFJpgMxD50UDdJ16VlQ==',key_name='tempest-TestStampPattern-310945430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74dd7809fa6b4cf185a02e8ffc0f5439',ramdisk_id='',reservation_id='r-1b5jz0ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617962097',owner_user_name='tempest-TestStampPattern-1617962097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:00:56Z,user_data=None,user_id='c600566c5fef49bdabb57bc0f8233049',uuid=60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converting VIF {"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG os_vif [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b02af37-0130-506c-bf87-8df17b607824', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3787f163-ec, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3787f163-ec, col_values=(('qos', UUID('4f6c2114-8998-4ee9-b66e-dbe4759382b8')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3787f163-ec, col_values=(('external_ids', {'iface-id': '3787f163-ec13-4032-a8b6-22b3ba8266d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:cb:dc', 'vm-uuid': '60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:00:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:57 user nova-compute[74429]: INFO os_vif [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec')
Oct 23 20:00:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:00:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No VIF found with MAC fa:16:3e:be:cb:dc, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:00:58 user nova-compute[74429]: DEBUG nova.network.neutron [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updated VIF entry in instance network info cache for port 3787f163-ec13-4032-a8b6-22b3ba8266d0. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:00:58 user nova-compute[74429]: DEBUG nova.network.neutron [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating instance_info_cache with network_info: [{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:00:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d328947d-1990-4572-a5d5-0cf8ad139afe req-a7632c46-4f14-4093-a6d7-b60edc18416f service nova] Releasing lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-392c6751-c17f-4731-be01-1addab3e6aa3 req-29de678d-f86f-4622-9a03-7961a6070e08 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received event network-vif-plugged-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-392c6751-c17f-4731-be01-1addab3e6aa3 req-29de678d-f86f-4622-9a03-7961a6070e08 service nova] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-392c6751-c17f-4731-be01-1addab3e6aa3 req-29de678d-f86f-4622-9a03-7961a6070e08 service nova] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-392c6751-c17f-4731-be01-1addab3e6aa3 req-29de678d-f86f-4622-9a03-7961a6070e08 service nova] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:00:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-392c6751-c17f-4731-be01-1addab3e6aa3 req-29de678d-f86f-4622-9a03-7961a6070e08 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] No waiting events found dispatching network-vif-plugged-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:00:59 user nova-compute[74429]: WARNING nova.compute.manager [req-392c6751-c17f-4731-be01-1addab3e6aa3 req-29de678d-f86f-4622-9a03-7961a6070e08 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received unexpected event network-vif-plugged-3787f163-ec13-4032-a8b6-22b3ba8266d0 for instance with vm_state building and task_state spawning.
Oct 23 20:01:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-27407fe6-33ff-461b-80cd-1c3868514c58 req-f65642b3-be0d-4a42-97d2-a6f2745f22ce service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received event network-vif-plugged-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27407fe6-33ff-461b-80cd-1c3868514c58 req-f65642b3-be0d-4a42-97d2-a6f2745f22ce service nova] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27407fe6-33ff-461b-80cd-1c3868514c58 req-f65642b3-be0d-4a42-97d2-a6f2745f22ce service nova] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27407fe6-33ff-461b-80cd-1c3868514c58 req-f65642b3-be0d-4a42-97d2-a6f2745f22ce service nova] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-27407fe6-33ff-461b-80cd-1c3868514c58 req-f65642b3-be0d-4a42-97d2-a6f2745f22ce service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] No waiting events found dispatching network-vif-plugged-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:01:01 user nova-compute[74429]: WARNING nova.compute.manager [req-27407fe6-33ff-461b-80cd-1c3868514c58 req-f65642b3-be0d-4a42-97d2-a6f2745f22ce service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received unexpected event network-vif-plugged-3787f163-ec13-4032-a8b6-22b3ba8266d0 for instance with vm_state building and task_state spawning.
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:01:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Instance spawned successfully.
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:01:02 user nova-compute[74429]: INFO nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 23 20:01:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:01:02 user nova-compute[74429]: INFO nova.compute.manager [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Took 7.17 seconds to build instance.
Oct 23 20:01:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2ec14988-428c-4509-8c70-bb4b2a1c519a tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.266s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:01:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:01:06 user nova-compute[74429]: INFO nova.compute.claims [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Claim successful on node user
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:01:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:01:07 user nova-compute[74429]: INFO nova.virt.block_device [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Booting with volume 1ce004c2-97c2-4424-bfaa-db850ba63ef1 at /dev/vda
Oct 23 20:01:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG os_brick.utils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6439ab1b-d28f-44a5-b657-2425861905a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d6d45-8820-45fd-96ec-78bf3d10b18a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3294a8ca-e41d-458f-bc33-91ce26ac87f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4edc13a-8133-40b5-8a49-0f87098a26bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:07 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:01:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c0481-f44a-4b53-8068-fb8693628d40]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG os_brick.utils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating existing volume attachment record: d567e5e1-2c7e-4ce4-8aa0-4fea7512be7e {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG nova.policy [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f8025204f0a43fcace00948d9ac54a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c56f49c4c14d4184db943b8f63fb8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:01:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:01:08 user nova-compute[74429]: INFO nova.compute.manager [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] instance snapshotting
Oct 23 20:01:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Beginning live snapshot process
Oct 23 20:01:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully created port: 5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:01:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully created port: 0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:01:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplkh3db0g/2ee9c1518bda4e14a200b38e7fc76be0.delta 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplkh3db0g/2ee9c1518bda4e14a200b38e7fc76be0.delta 1073741824" returned: 0 in 0.060s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:09 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 20:01:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74429) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 23 20:01:09 user nova-compute[74429]: INFO nova.virt.libvirt.host [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] UEFI support detected
Oct 23 20:01:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully created port: 1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:01:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:01:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully created port: d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:01:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:01:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 20:01:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:01:10 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:01:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplkh3db0g/2ee9c1518bda4e14a200b38e7fc76be0.delta /opt/stack/data/nova/instances/snapshots/tmplkh3db0g/2ee9c1518bda4e14a200b38e7fc76be0 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully created port: 62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-changed-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Refreshing instance network info cache due to event network-changed-a6a5270f-79da-4735-a1f4-5bc0fac5259d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG nova.network.neutron [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Refreshing network info cache for port a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplkh3db0g/2ee9c1518bda4e14a200b38e7fc76be0.delta /opt/stack/data/nova/instances/snapshots/tmplkh3db0g/2ee9c1518bda4e14a200b38e7fc76be0" returned: 0 in 1.030s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:11 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Snapshot extracted, beginning image upload
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: 5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-5fd49d73-8202-45c2-bce0-af9878f2f69d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port 5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updated VIF entry in instance network info cache for port a6a5270f-79da-4735-a1f4-5bc0fac5259d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-db6d59a7-15dc-4254-9331-159e72162ee3 req-5190ab3f-d9b8-4dc8-aaff-35640e1e4a60 service nova] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updating instance_info_cache with network_info: [{"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-d1572158-f516-4454-96ce-4a5e720b4041" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8a886e13-b21f-4066-aad4-a73fa4a2d014 req-f596689c-66f6-471e-b636-95783dde4eb0 service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:01:13 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing instance network info cache due to event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.network.neutron [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: 0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-ec078dd6-2e2c-4756-b098-7440ac870016. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.network.neutron [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:14 user nova-compute[74429]: DEBUG nova.network.neutron [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-0dc7dfb3-0a86-4bc9-9946-1d47284331ee. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port 0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updated VIF entry in instance network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e512c21d-a6b5-4337-a24c-75f0b44138b5 req-8ac7c03f-fe6b-4ecc-b5dd-cf8ce6503699 service nova] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8979b961-9334-4dd7-aeb4-5163b4014471 req-f8b88595-2422-4761-bd5a-b5e4b29418d5 service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Snapshot image upload complete
Oct 23 20:01:15 user nova-compute[74429]: INFO nova.compute.manager [None req-db9fd41d-8f22-4a85-999a-3ee44c822430 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Took 7.48 seconds to snapshot the instance on the hypervisor.
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: 0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:01:16 user nova-compute[74429]: INFO nova.compute.manager [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] instance snapshotting
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Beginning live snapshot process
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json -f qcow2" returned: 0 in 0.249s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: 1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG nova.network.neutron [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port 0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json -f qcow2" returned: 0 in 0.313s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:16 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lazy-loading 'flavor' on Instance uuid d1572158-f516-4454-96ce-4a5e720b4041 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu01sj8a_/6bb594eff3b24854b6877ec03a9a3e39.delta 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu01sj8a_/6bb594eff3b24854b6877ec03a9a3e39.delta 1073741824" returned: 0 in 0.054s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:17 user nova-compute[74429]: INFO nova.compute.manager [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Attaching volume 8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 to /dev/vdb
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG os_brick.utils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11dda35-f903-4e70-9648-d724776c76b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3194a057-6fea-4234-b36f-36eba10589a5 req-15aa28d8-404c-4a7d-a065-6e80d1df85a2 service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9008a649-1b2d-4af2-a538-9c2501f28e68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c805ba52-afcb-4617-a40e-68fd0c89e4fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c23c30-bfab-4340-b01b-facc6b115ac3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:17 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1a3ba-af31-47d0-be8c-35e57ddfb8ce]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG os_brick.utils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updating existing volume attachment record: 1d2b24d2-85cc-4f68-821a-c79e623daf8d {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:01:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:01:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:01:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7277MB free_disk=25.702041625976562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu01sj8a_/6bb594eff3b24854b6877ec03a9a3e39.delta /opt/stack/data/nova/instances/snapshots/tmpu01sj8a_/6bb594eff3b24854b6877ec03a9a3e39 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d1572158-f516-4454-96ce-4a5e720b4041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 18e01426-64cf-4ca4-90b6-58e17f80242c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d35828f9-195d-4ece-a2d9-db474bc6b581 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-1075b40b-72dd-4cd0-9f92-4df660e297a2. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:18 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port 1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu01sj8a_/6bb594eff3b24854b6877ec03a9a3e39.delta /opt/stack/data/nova/instances/snapshots/tmpu01sj8a_/6bb594eff3b24854b6877ec03a9a3e39" returned: 0 in 0.293s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:19 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Snapshot extracted, beginning image upload
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-d962c332-6693-43a2-ba24-a4d39677f1d6. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Successfully updated port: 62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd68faee-7075-4d4c-af50-3050759b4ace req-729f03e4-6b3d-4441-a24e-7d2ea94fe8d3 service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:01:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:01:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:01:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-62a87f4c-7859-48e7-b8b6-12f4c716195d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Snapshot image upload complete
Oct 23 20:01:22 user nova-compute[74429]: INFO nova.compute.manager [None req-84932507-0903-48c9-bfee-0e41ad48e8cc tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Took 6.28 seconds to snapshot the instance on the hypervisor.
Oct 23 20:01:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [{"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance network_info: |[{"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port 62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updated VIF entry in instance network info cache for port 62a87f4c-7859-48e7-b8b6-12f4c716195d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [{"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-853a7c1d-18c7-4c2e-9ec9-5fa030b0e65e req-be767e7e-26be-4906-8a57-d995437881ff service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:28 user nova-compute[74429]: INFO nova.virt.block_device [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Booting with volume da174691-ba88-4aef-a213-4b35f37a3d2c at /dev/vdb
Oct 23 20:01:28 user nova-compute[74429]: DEBUG os_brick.utils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82e3ca-52ff-4017-b9a1-3d5e67b127dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c578dc02-9880-4707-8888-31a30cda9641]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1468804b-a4ce-465f-bbb8-cf57785e7531]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661b2e8-2235-4a3f-868a-bb094358c203]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:28 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:01:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef386717-7c63-4703-af87-0c124db39875]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG os_brick.utils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating existing volume attachment record: cc0089c5-1258-45a2-95c8-2ba093e239b2 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:01:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-changed-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Refreshing instance network info cache due to event network-changed-1dea4302-ed87-4c99-9089-e02dae437431. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] Acquiring lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] Acquired lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Refreshing network info cache for port 1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Updated VIF entry in instance network info cache for port 1dea4302-ed87-4c99-9089-e02dae437431. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:01:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Updating instance_info_cache with network_info: [{"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c679ca7-7424-402d-8378-8101c6e6b57b req-51d14099-6417-4b76-b0f8-3162809d7a4d service nova] Releasing lock "refresh_cache-fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdUYvKyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:01:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:01:36 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d863aaf9-5e92-475c-8e21-336ce368afcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:01:36 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a529b39-8c7a-48df-b6ad-782354acbd67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7] added
Oct 23 20:01:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ff9f93-ba32-4f8c-a330-c5b54099e348]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bfafda-808a-4186-9f09-4277a118d784]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdUYvKyf {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdUYvKyf" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f82f9b6-5bc9-45d1-bd96-ee0061c28341]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdUYvKyf'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb82fe3-dea1-4a5b-8b74-97757830b260]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95b46ac-bd8f-4562-960b-abeb212a1d72]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5e6b5-85d4-4722-bd11-cff1e33224d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260]
Oct 23 20:01:36 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260] successful.
Oct 23 20:01:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bab7ef-bdee-4ab5-90cd-2ee9626d2e5d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[163278cb-f845-448c-9b42-9701d51ed9c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:36 user nova-compute[74429]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 (non-flash)
Oct 23 20:01:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:36 user nova-compute[74429]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 (non-flash)
Oct 23 20:01:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf6cf02-c80a-4680-b456-480185e76aaf]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:01:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdUYvKyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:01:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:01:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23632343932326531', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632343932326531', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:01:37 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lazy-loading 'flavor' on Instance uuid d1572158-f516-4454-96ce-4a5e720b4041 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:01:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:01:37 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:01:37 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:01:37 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:01:37 user nova-compute[74429]:   <serial>8c2ef19d-9484-4984-8fe9-f5c30fddaeb7</serial>
Oct 23 20:01:37 user nova-compute[74429]: </disk>
Oct 23 20:01:37 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] No VIF found with MAC fa:16:3e:12:dc:a9, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ebcface7-bf50-4885-91ef-d2e53f2d095f tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.421s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lazy-loading 'flavor' on Instance uuid fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:01:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:39 user nova-compute[74429]: INFO nova.compute.manager [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Attaching volume 6211386f-d459-4328-b786-06e7e9dc4d0c to /dev/sdc
Oct 23 20:01:39 user nova-compute[74429]: DEBUG os_brick.utils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c177a-4e93-4074-97ef-314aa38fdd98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d425d654-2898-492d-b887-5dd0c9d8500f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a375acd-6d54-4361-970a-3d0738bb5d52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[711775c1-a085-42af-bf99-f35c2cf7398b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:39 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[917c6522-133a-42ae-b21d-9395afe0cbc7]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG os_brick.utils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Updating existing volume attachment record: 61b24688-a14c-4345-9431-a2c95bcaf828 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:39 user nova-compute[74429]: INFO nova.compute.manager [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Terminating instance
Oct 23 20:01:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-9e6aa848-b5ea-41e3-9eb9-b98db0fe8f52 req-3c71240b-b099-446c-9546-c817d8768ac5 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-vif-unplugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9e6aa848-b5ea-41e3-9eb9-b98db0fe8f52 req-3c71240b-b099-446c-9546-c817d8768ac5 service nova] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9e6aa848-b5ea-41e3-9eb9-b98db0fe8f52 req-3c71240b-b099-446c-9546-c817d8768ac5 service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9e6aa848-b5ea-41e3-9eb9-b98db0fe8f52 req-3c71240b-b099-446c-9546-c817d8768ac5 service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-9e6aa848-b5ea-41e3-9eb9-b98db0fe8f52 req-3c71240b-b099-446c-9546-c817d8768ac5 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] No waiting events found dispatching network-vif-unplugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:01:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-9e6aa848-b5ea-41e3-9eb9-b98db0fe8f52 req-3c71240b-b099-446c-9546-c817d8768ac5 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-vif-unplugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Instance destroyed successfully.
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.objects.instance [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lazy-loading 'resources' on Instance uuid d1572158-f516-4454-96ce-4a5e720b4041 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1739153548',display_name='tempest-DeleteServersTestJSON-server-1739153548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1739153548',id=2,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f35111cd84e4675a2c24ab7a281e864',ramdisk_id='',reservation_id='r-kkzsh00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1545853121',owner_user_name='tempest-DeleteServersTestJSON-1545853121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T19:59:34Z,user_data=None,user_id='93f98ed657864e77ac02003f9e960778',uuid=d1572158-f516-4454-96ce-4a5e720b4041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Converting VIF {"id": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "address": "fa:16:3e:12:dc:a9", "network": {"id": "64e46c1c-4b0a-4d27-b797-5464e5abdff7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1790698796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f35111cd84e4675a2c24ab7a281e864", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312c09b5-71", "ovs_interfaceid": "312c09b5-717e-4cf0-9b83-b5fdc2cf4316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_vif [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312c09b5-71, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59b5a2b1-954f-425f-971a-90520e312eb6) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: INFO os_vif [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:dc:a9,bridge_name='br-int',has_traffic_filtering=True,id=312c09b5-717e-4cf0-9b83-b5fdc2cf4316,network=Network(64e46c1c-4b0a-4d27-b797-5464e5abdff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312c09b5-71')
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdUYvKyf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:40 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4dfa06-ba42-416a-9f78-b5f622a3ee9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:01:40 user nova-compute[74429]: No targets found.
Oct 23 20:01:40 user nova-compute[74429]: iSNS:
Oct 23 20:01:40 user nova-compute[74429]: No targets found.
Oct 23 20:01:40 user nova-compute[74429]: STATIC:
Oct 23 20:01:40 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7
Oct 23 20:01:40 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:01:40 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:01:40 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:01:40 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:01:40 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:01:40 user nova-compute[74429]: FIRMWARE:
Oct 23 20:01:40 user nova-compute[74429]: No targets found.
Oct 23 20:01:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:01:40 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:01:40 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce053b-03f0-4ff0-b70a-c39710473ce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8098e9-1df8-4555-95c3-26b76133f6b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:40 user nova-compute[74429]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 (non-flash)
Oct 23 20:01:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:40 user nova-compute[74429]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 (non-flash)
Oct 23 20:01:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580da0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef3be4a-dca6-4285-9c2d-e434b2c3bdc9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b7ebc-a366-4f71-b029-7a747ea03247]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c6381-8aef-4206-a1ac-2e50794dbab8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e2b53-daf9-4ceb-ae9c-a1cc4182ce4a]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c086e9-5eeb-4b05-8e0d-b398cb1fa8c6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8460f68-bbc6-4286-8324-e513beb567ef]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260]
Oct 23 20:01:40 user nova-compute[74429]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7, portal: 172.16.0.220,3260] successful.
Oct 23 20:01:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2ef19d-9484-4984-8fe9-f5c30fddaeb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0ad1f4-3f3b-471a-a46c-9f039584a57a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] <== disconnect_volume: return (320ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:01:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Deleting instance files /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041_del
Oct 23 20:01:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Deletion of /opt/stack/data/nova/instances/d1572158-f516-4454-96ce-4a5e720b4041_del complete
Oct 23 20:01:40 user nova-compute[74429]: INFO nova.compute.manager [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 23 20:01:40 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: d1572158-f516-4454-96ce-4a5e720b4041] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:41 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Took 0.64 seconds to deallocate network for instance.
Oct 23 20:01:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-24d4cae5-053f-40fc-9014-b4d39fe395ea req-915b9676-7aec-4fc5-a885-709edf2789b3 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-vif-deleted-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-b7d2fc42-f3d7-40eb-ae86-36cbf88d7d8d req-5fc125b2-020d-48d3-89ea-0fc33e7d7d56 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received event network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7d2fc42-f3d7-40eb-ae86-36cbf88d7d8d req-5fc125b2-020d-48d3-89ea-0fc33e7d7d56 service nova] Acquiring lock "d1572158-f516-4454-96ce-4a5e720b4041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7d2fc42-f3d7-40eb-ae86-36cbf88d7d8d req-5fc125b2-020d-48d3-89ea-0fc33e7d7d56 service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7d2fc42-f3d7-40eb-ae86-36cbf88d7d8d req-5fc125b2-020d-48d3-89ea-0fc33e7d7d56 service nova] Lock "d1572158-f516-4454-96ce-4a5e720b4041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-b7d2fc42-f3d7-40eb-ae86-36cbf88d7d8d req-5fc125b2-020d-48d3-89ea-0fc33e7d7d56 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] No waiting events found dispatching network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:01:41 user nova-compute[74429]: WARNING nova.compute.manager [req-b7d2fc42-f3d7-40eb-ae86-36cbf88d7d8d req-5fc125b2-020d-48d3-89ea-0fc33e7d7d56 service nova] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Received unexpected event network-vif-plugged-312c09b5-717e-4cf0-9b83-b5fdc2cf4316 for instance with vm_state active and task_state deleting.
Oct 23 20:01:42 user nova-compute[74429]: INFO nova.compute.manager [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] [instance: d1572158-f516-4454-96ce-4a5e720b4041] Took 0.85 seconds to detach 1 volumes for instance.
Oct 23 20:01:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:42 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:01:42 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:01:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:42 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Deleted allocations for instance d1572158-f516-4454-96ce-4a5e720b4041
Oct 23 20:01:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-121500be-3e27-4249-8952-ba684cf00a76 tempest-DeleteServersTestJSON-1545853121 tempest-DeleteServersTestJSON-1545853121-project-member] Lock "d1572158-f516-4454-96ce-4a5e720b4041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.491s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-changed-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:01:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Refreshing instance network info cache due to event network-changed-9f4b61ff-cd8d-4d17-ba69-45c15de516b7. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:01:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] Acquiring lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:01:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] Acquired lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:01:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Refreshing network info cache for port 9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lazy-loading 'flavor' on Instance uuid a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updated VIF entry in instance network info cache for port 9f4b61ff-cd8d-4d17-ba69-45c15de516b7. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updating instance_info_cache with network_info: [{"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:01:46 user nova-compute[74429]: INFO nova.compute.manager [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Attaching volume 8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d to /dev/vdb
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-88fb4e4a-b8c9-4338-bd1a-ed9f345d2ccb req-f6c7c19d-5ba6-4bf5-9c36-70ceeb357514 service nova] Releasing lock "refresh_cache-a6d3a4b5-09f8-4c00-bec0-3793752ead25" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG os_brick.utils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1bc91e-d381-440c-9bc1-fb90c7c8b8e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ec5c38-0ff0-4de5-ad5b-37f2f0140ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7f618-2db6-433c-91b7-2fa88ec9c988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049cbf2-83f7-4654-bfd8-0b7640c89213]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:46 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:01:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b5ac3a-bcec-44e7-a9fd-58f757d89a19]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG os_brick.utils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:46 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updating existing volume attachment record: 3903f5c6-edf6-4176-ba68-41fd2c3de955 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:47 user nova-compute[74429]: INFO nova.virt.block_device [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Booting with volume 120fa027-74b8-488c-93b1-3c3860bdd749 at /dev/vdc
Oct 23 20:01:47 user nova-compute[74429]: DEBUG os_brick.utils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4182e617-97d5-4daf-9994-44786d32029f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b638b66c-6aee-495d-8a2c-b3a6fd641417]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ac9ab-e803-40c0-9f86-38eb5dfab258]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9322f-273d-4393-bea0-d7c1529556ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:01:47 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:01:47 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[60292535-280d-420c-a9f3-c7b5f6e1251c]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG os_brick.utils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:47 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating existing volume attachment record: 4c60062d-ca5b-4ad2-99a1-0de9939a934b {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:01:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOHoMwes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:01:57 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:01:57 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:01:57 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa834e6f-643c-4778-9c67-fecffeeda4b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:01:57 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad240494-b9bb-4d3c-9cd0-0c9bb25b1ea8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c] added
Oct 23 20:01:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f887000-bca8-4dcc-934a-1bed0648a2d5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef568bc5-09a5-4957-ad41-33bbc7b5865f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOHoMwes {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOHoMwes" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb999d7d-8b0e-4f33-907e-1b41e753d7b3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jOHoMwes'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f8e2cb-c619-4f1a-9655-77a99740f4f6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc9ae61-f040-404c-81ab-fad8e097a57d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[075fe2a2-1013-443d-9591-e8bed32a5880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260]
Oct 23 20:01:57 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260] successful.
Oct 23 20:01:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a9b3bf-3da7-4767-93a5-bc9b75f187ae]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21af06-75d3-4cf0-8379-9de3eccd6576]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:57 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:01:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:01:57 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:01:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0788421-a586-436a-92a6-d9c9110d0870]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:01:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOHoMwes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:01:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:01:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26363356661303331', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:01:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363356661303331', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:01:58 user nova-compute[74429]: DEBUG nova.objects.instance [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lazy-loading 'flavor' on Instance uuid fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:01:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:01:58 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:01:58 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:01:58 user nova-compute[74429]:   <target dev="sdc" bus="scsi"/>
Oct 23 20:01:58 user nova-compute[74429]:   <serial>6211386f-d459-4328-b786-06e7e9dc4d0c</serial>
Oct 23 20:01:58 user nova-compute[74429]:   <address type="drive" controller="0" unit="2"/>
Oct 23 20:01:58 user nova-compute[74429]: </disk>
Oct 23 20:01:58 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:01:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No BDM found with device name sda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:01:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:01:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:01:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] No VIF found with MAC fa:16:3e:54:d1:e1, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:01:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-db1d780b-442a-422c-a109-cc4f4b4e2120 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.377s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:00 user nova-compute[74429]: INFO nova.compute.manager [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Detaching volume 6211386f-d459-4328-b786-06e7e9dc4d0c
Oct 23 20:02:00 user nova-compute[74429]: INFO nova.virt.block_device [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Attempting to driver detach volume 6211386f-d459-4328-b786-06e7e9dc4d0c from mountpoint /dev/sdc
Oct 23 20:02:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Attempting to detach device sdc from instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:02:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:02:00 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:00 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:02:00 user nova-compute[74429]:   <target dev="sdc" bus="scsi"/>
Oct 23 20:02:00 user nova-compute[74429]:   <serial>6211386f-d459-4328-b786-06e7e9dc4d0c</serial>
Oct 23 20:02:00 user nova-compute[74429]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 20:02:00 user nova-compute[74429]: </disk>
Oct 23 20:02:00 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:02:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Successfully detached device sdc from instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 from the persistent domain config.
Oct 23 20:02:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:02:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:02:00 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:00 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:02:00 user nova-compute[74429]:   <target dev="sdc" bus="scsi"/>
Oct 23 20:02:00 user nova-compute[74429]:   <serial>6211386f-d459-4328-b786-06e7e9dc4d0c</serial>
Oct 23 20:02:00 user nova-compute[74429]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 20:02:00 user nova-compute[74429]: </disk>
Oct 23 20:02:00 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:02:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-changed-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Refreshing instance network info cache due to event network-changed-4157a0b7-da9e-4379-b63e-8d7305dbf6b1. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] Acquiring lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] Acquired lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Refreshing network info cache for port 4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lazy-loading 'flavor' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:01 user nova-compute[74429]: INFO nova.compute.manager [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Attaching volume 252d8f78-24fa-45e4-a44f-8676d9b67328 to /dev/vdb
Oct 23 20:02:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updated VIF entry in instance network info cache for port 4157a0b7-da9e-4379-b63e-8d7305dbf6b1. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updating instance_info_cache with network_info: [{"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f564afd0-6b29-4d17-bedf-dccc628ec60e req-7f4c84bf-e90f-4e49-b2c9-d992af1d5fb0 service nova] Releasing lock "refresh_cache-1a41ae88-9f6c-47c4-a7d5-e2501228b313" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG os_brick.utils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[91084d88-e7f6-46d7-b69b-65646f44e790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b19e33e-dac8-458c-94df-246323f8cc80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f35c88-a071-40ba-9e5e-c80fe8530c86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9aee35-1d83-4087-8f14-65169a953412]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:02 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:02:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcfedb1-f5cb-4b29-9a40-4309444a06ea]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG os_brick.utils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updating existing volume attachment record: 3479f472-f009-4cd4-a309-c7ea96b0c454 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:02:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJqOWCeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:05 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:05 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:05 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8a8dec-dfcd-4c9c-9072-642346cbaefb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:02:05 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f375008-c086-4b83-a342-6ed7adfce2bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d] added
Oct 23 20:02:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b5e64-6fd6-4b01-9db6-4086856797f8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a78a4f9-00c6-4d8e-95f7-1b03f277352c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJqOWCeI {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NJqOWCeI" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d55b08-9c91-4226-8907-5e683fa1e6f9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NJqOWCeI'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[473cd076-3a03-49fd-aefc-db0810b7d8a8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d10740-648d-4ef8-bb01-f31c8d9c8765]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:05 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:05 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6c2d2c-aa5e-4013-9405-fe781910acf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260]
Oct 23 20:02:05 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ac9bdb-1d23-414c-a7d4-f8fb81804939]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5164b9b4-8738-44f1-a13a-ba93cb6c7c4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:05 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:05 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:05 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:05 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[44edda75-2fe0-4387-a440-fd55c758c014]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJqOWCeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26662393431616131', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662393431616131', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lazy-loading 'flavor' on Instance uuid a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] attach device xml: <disk type="block" device="disk">
Oct 23 20:02:06 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:06 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:02:06 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:02:06 user nova-compute[74429]:   <serial>8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d</serial>
Oct 23 20:02:06 user nova-compute[74429]: </disk>
Oct 23 20:02:06 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:02:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Creating image(s)
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Ensure instance console log exists: /opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Start _get_guest_xml network_info=[{"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'd567e5e1-2c7e-4ce4-8aa0-4fea7512be7e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqeNZsyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35828f9-195d-4ece-a2d9-db474bc6b581', 'attached_at': '', 'detached_at': '', 'volume_id': '1ce004c2-97c2-4424-bfaa-db850ba63ef1', 'serial': '1ce004c2-97c2-4424-bfaa-db850ba63ef1'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': 'cc0089c5-1258-45a2-95c8-2ba093e239b2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrItNjLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35828f9-195d-4ece-a2d9-db474bc6b581', 'attached_at': '', 'detached_at': '', 'volume_id': 'da174691-ba88-4aef-a213-4b35f37a3d2c', 'serial': 'da174691-ba88-4aef-a213-4b35f37a3d2c'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '4c60062d-ca5b-4ad2-99a1-0de9939a934b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcxSyDmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35828f9-195d-4ece-a2d9-db474bc6b581', 'attached_at': '', 'detached_at': '', 'volume_id': '120fa027-74b8-488c-93b1-3c3860bdd749', 'serial': '120fa027-74b8-488c-93b1-3c3860bdd749'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:02:06 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:02:06 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqeNZsyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:06 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:06 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:06 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c320571c-6df3-4b7b-8ce8-d6c6f3269c0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:02:06 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddf75e8-1932-4bf6-94a4-353a384bb26b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1] added
Oct 23 20:02:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbc583c-105b-4562-bc6e-ae9daf3263d2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ae6c98-ec72-428f-95d6-1d319a12e4b7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqeNZsyP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqeNZsyP" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0a5cf-c027-480c-9a34-bf6e6dbc9400]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqeNZsyP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9ddf58-01b2-45b2-982b-6e1e79717c9b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] No VIF found with MAC fa:16:3e:6d:50:3b, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e545936-41ea-476d-a78c-2868c141ba20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:06 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:06 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:06 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:06 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d791f9f8-0e93-40ef-867b-03568f27509d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260]
Oct 23 20:02:07 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1e280-f8f4-4b27-be19-b1fdb3b9b20d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bdea2f-5ca6-411a-b52b-c943abfd2e39]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:07 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:07 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:07 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:07 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:07 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:07 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-957df426-6b8f-48fa-a86a-073cd6dd74cf tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.676s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f900d-e047-47d3-b1e2-2e3ac0a0b6ee]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqeNZsyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] volume_snapshot_create: create_info: {'snapshot_id': '4556d8c6-46ab-429f-ad97-76111c7976cb', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74429) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] snap xml: <domainsnapshot>
Oct 23 20:02:07 user nova-compute[74429]:   <disks>
Oct 23 20:02:07 user nova-compute[74429]:     <disk name="/dev/sdd" snapshot="external" type="file">
Oct 23 20:02:07 user nova-compute[74429]:       <source file="/dev/new_file"/>
Oct 23 20:02:07 user nova-compute[74429]:     </disk>
Oct 23 20:02:07 user nova-compute[74429]:     <disk name="vda" snapshot="no"/>
Oct 23 20:02:07 user nova-compute[74429]:   </disks>
Oct 23 20:02:07 user nova-compute[74429]: </domainsnapshot>
Oct 23 20:02:07 user nova-compute[74429]:  {{(pid=74429) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 23 20:02:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] Lazy-loading 'system_metadata' on Instance uuid a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     rv = execute(f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     six.reraise(c, e, tb)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     raise value
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     rv = meth(*args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     self._volume_snapshot_create(context, instance, guest,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     rv = execute(f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     six.reraise(c, e, tb)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     raise value
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     rv = meth(*args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] 
Oct 23 20:02:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-be69f0ac-0f6b-445b-998e-5b831a7e2a30 tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] volume_snapshot_delete: delete_info: {'volume_id': '8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d'} {{(pid=74429) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [None req-be69f0ac-0f6b-445b-998e-5b831a7e2a30 tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25]     if delete_info['type'] != 'qcow2':
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] KeyError: 'type'
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 4556d8c6-46ab-429f-ad97-76111c7976cb could not be found.
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise value
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 4556d8c6-46ab-429f-ad97-76111c7976cb could not be found. (HTTP 404) (Request-ID: req-37fd0b64-3e32-4280-8cbd-411f15f2e125)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 4556d8c6-46ab-429f-ad97-76111c7976cb could not be found.
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server [None req-385aebd6-9214-434c-88ec-befcc5a6b78a tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     raise value
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver [None req-be69f0ac-0f6b-445b-998e-5b831a7e2a30 tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-88937177-80c3-4f47-8dbb-5f5eab0ddbe3)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 20:02:07 user nova-compute[74429]: ERROR nova.virt.libvirt.driver 
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server [None req-be69f0ac-0f6b-445b-998e-5b831a7e2a30 tempest-VolumesAssistedSnapshotsTest-1572249870 tempest-VolumesAssistedSnapshotsTest-1572249870-project] Exception during message handling: KeyError: 'type'
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 23 20:02:07 user nova-compute[74429]: ERROR oslo_messaging.rpc.server 
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26632313161616365', 'path': '/dev/sde'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313161616365', 'path': '/dev/sde'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrItNjLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:08 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:08 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:08 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4dd8a6-caa7-4fd2-89f8-bf5587560b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:02:08 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38c47e-a891-4f4a-8e93-42f43d24c436]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c] added
Oct 23 20:02:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051f39a-36c6-4cab-b7f8-532cacede088]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea48cc6d-eff0-44be-a283-cd9c5494f2e0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrItNjLC {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrItNjLC" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e41d9-d4f7-4736-ab89-3043a63e443e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrItNjLC'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee504fe0-cdd1-47f6-b569-1a2368719237]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e21f74b-4d3f-43f6-9f26-d1b22088cfe1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: INFO nova.compute.manager [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Detaching volume 8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d
Oct 23 20:02:08 user nova-compute[74429]: INFO nova.virt.block_device [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Attempting to driver detach volume 8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d from mountpoint /dev/vdb
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Attempting to detach device vdb from instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 20:02:08 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:08 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:02:08 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:02:08 user nova-compute[74429]:   <serial>8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d</serial>
Oct 23 20:02:08 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:02:08 user nova-compute[74429]: </disk>
Oct 23 20:02:08 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb2aeee-057c-486a-a549-055273c0dc36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260]
Oct 23 20:02:08 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Successfully detached device vdb from instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 from the persistent domain config.
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 20:02:08 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:08 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:02:08 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:02:08 user nova-compute[74429]:   <serial>8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d</serial>
Oct 23 20:02:08 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:02:08 user nova-compute[74429]: </disk>
Oct 23 20:02:08 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d35cda-db51-4703-8210-89422d396298]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0bd95-eba4-4bab-b1c1-c240abed2334]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:08 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ff49b2-a20a-4c05-a40e-0fb5bc7e1ac0]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrItNjLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26363633165643632', 'path': '/dev/sdf'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363633165643632', 'path': '/dev/sdf'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcxSyDmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:09 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:09 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:09 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b19ea6-c934-4ca1-9316-fcb4ae9a954e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:02:09 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc1d355-c4ec-48c8-8cf3-8b9c4c7677cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749] added
Oct 23 20:02:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fb389a-a99d-4a2d-ad88-aff20a536c5f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[684650de-4de0-4c90-a2a5-e56c2dc943ac]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcxSyDmZ {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcxSyDmZ" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe6bd5d-6383-4447-b774-1b85ea3c2a01]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcxSyDmZ'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acef945-3bbe-4370-9a28-2823c8ed2641]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1d090-6bb6-4361-9187-dec6b2927cb5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[572f5b2d-bc3e-46d8-ac9c-c2a75ddff243]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260]
Oct 23 20:02:09 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5db73a-8494-4c86-bb1b-53a1d41b8f4d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e4910-b316-4d4b-9de0-9e9ff0f413a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:09 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[691484a9-7605-449f-8360-d33ada11e4e0]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcxSyDmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23464323365373330', 'path': '/dev/sdg'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464323365373330', 'path': '/dev/sdg'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.objects.instance [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lazy-loading 'pci_devices' on Instance uuid d35828f9-195d-4ece-a2d9-db474bc6b581 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:02:10 user nova-compute[74429]:   <uuid>d35828f9-195d-4ece-a2d9-db474bc6b581</uuid>
Oct 23 20:02:10 user nova-compute[74429]:   <name>instance-0000000a</name>
Oct 23 20:02:10 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:02:10 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:02:10 user nova-compute[74429]:   <metadata>
Oct 23 20:02:10 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:02:10 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:02:10 user nova-compute[74429]:       <nova:name>tempest-device-tagging-server-1249677625</nova:name>
Oct 23 20:02:10 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:02:06</nova:creationTime>
Oct 23 20:02:10 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:02:10 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:02:10 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:02:10 user nova-compute[74429]:       <nova:owner>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:user uuid="5f8025204f0a43fcace00948d9ac54a4">tempest-TaggedBootDevicesTest_v242-588228488-project-member</nova:user>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:project uuid="52c56f49c4c14d4184db943b8f63fb8d">tempest-TaggedBootDevicesTest_v242-588228488</nova:project>
Oct 23 20:02:10 user nova-compute[74429]:       </nova:owner>
Oct 23 20:02:10 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:02:10 user nova-compute[74429]:       <nova:ports>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="5fd49d73-8202-45c2-bce0-af9878f2f69d">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="ec078dd6-2e2c-4756-b098-7440ac870016">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.231" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="0dc7dfb3-0a86-4bc9-9946-1d47284331ee">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="1075b40b-72dd-4cd0-9f92-4df660e297a2">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="d962c332-6693-43a2-ba24-a4d39677f1d6">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:         <nova:port uuid="62a87f4c-7859-48e7-b8b6-12f4c716195d">
Oct 23 20:02:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 20:02:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:02:10 user nova-compute[74429]:       </nova:ports>
Oct 23 20:02:10 user nova-compute[74429]:     </nova:instance>
Oct 23 20:02:10 user nova-compute[74429]:   </metadata>
Oct 23 20:02:10 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:02:10 user nova-compute[74429]:     <system>
Oct 23 20:02:10 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:02:10 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:02:10 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:02:10 user nova-compute[74429]:       <entry name="serial">d35828f9-195d-4ece-a2d9-db474bc6b581</entry>
Oct 23 20:02:10 user nova-compute[74429]:       <entry name="uuid">d35828f9-195d-4ece-a2d9-db474bc6b581</entry>
Oct 23 20:02:10 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:02:10 user nova-compute[74429]:     </system>
Oct 23 20:02:10 user nova-compute[74429]:   </sysinfo>
Oct 23 20:02:10 user nova-compute[74429]:   <os>
Oct 23 20:02:10 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:02:10 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:02:10 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:02:10 user nova-compute[74429]:   </os>
Oct 23 20:02:10 user nova-compute[74429]:   <features>
Oct 23 20:02:10 user nova-compute[74429]:     <acpi/>
Oct 23 20:02:10 user nova-compute[74429]:     <apic/>
Oct 23 20:02:10 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:02:10 user nova-compute[74429]:   </features>
Oct 23 20:02:10 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:02:10 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:02:10 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:02:10 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:02:10 user nova-compute[74429]:   </clock>
Oct 23 20:02:10 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:02:10 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:02:10 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:02:10 user nova-compute[74429]:   </cpu>
Oct 23 20:02:10 user nova-compute[74429]:   <devices>
Oct 23 20:02:10 user nova-compute[74429]:     <disk type="file" device="cdrom">
Oct 23 20:02:10 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 20:02:10 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581/disk.config"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="hda" bus="ide"/>
Oct 23 20:02:10 user nova-compute[74429]:     </disk>
Oct 23 20:02:10 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:02:10 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:10 user nova-compute[74429]:       <source dev="/dev/sde"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <serial>1ce004c2-97c2-4424-bfaa-db850ba63ef1</serial>
Oct 23 20:02:10 user nova-compute[74429]:     </disk>
Oct 23 20:02:10 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:02:10 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:10 user nova-compute[74429]:       <source dev="/dev/sdf"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <serial>da174691-ba88-4aef-a213-4b35f37a3d2c</serial>
Oct 23 20:02:10 user nova-compute[74429]:     </disk>
Oct 23 20:02:10 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:02:10 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:10 user nova-compute[74429]:       <source dev="/dev/sdg"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="vdc" bus="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <serial>120fa027-74b8-488c-93b1-3c3860bdd749</serial>
Oct 23 20:02:10 user nova-compute[74429]:     </disk>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:5b:9e:18"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tap5fd49d73-82"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:6f:3e:5d"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tapec078dd6-2e"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:6a:15:2a"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tap0dc7dfb3-0a"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:7c:e0:98"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tap0b53f44b-d9"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:0c:4e:e7"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tap1075b40b-72"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:88:92:38"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tapd962c332-66"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:02:10 user nova-compute[74429]:       <mac address="fa:16:3e:78:a4:db"/>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:02:10 user nova-compute[74429]:       <target dev="tap62a87f4c-78"/>
Oct 23 20:02:10 user nova-compute[74429]:     </interface>
Oct 23 20:02:10 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:02:10 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581/console.log" append="off"/>
Oct 23 20:02:10 user nova-compute[74429]:     </serial>
Oct 23 20:02:10 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:02:10 user nova-compute[74429]:     <video>
Oct 23 20:02:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:02:10 user nova-compute[74429]:     </video>
Oct 23 20:02:10 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:02:10 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:02:10 user nova-compute[74429]:     </rng>
Oct 23 20:02:10 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:02:10 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:02:10 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:02:10 user nova-compute[74429]:     </memballoon>
Oct 23 20:02:10 user nova-compute[74429]:   </devices>
Oct 23 20:02:10 user nova-compute[74429]: </domain>
Oct 23 20:02:10 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4bc74f6-29d3-56df-8e03-a86c267a7ad9', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fd49d73-82, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fd49d73-82, col_values=(('qos', UUID('4bdb560b-78df-4f27-8d2a-f9c8c6562b1d')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fd49d73-82, col_values=(('external_ids', {'iface-id': '5fd49d73-8202-45c2-bce0-af9878f2f69d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:9e:18', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82')
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8ca7ab2-bf96-5d07-96de-5e1422164f1c', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec078dd6-2e, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec078dd6-2e, col_values=(('qos', UUID('e673f2e1-0bb5-439d-bff6-3fcd447aa91c')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec078dd6-2e, col_values=(('external_ids', {'iface-id': 'ec078dd6-2e2c-4756-b098-7440ac870016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:3e:5d', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e')
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a51e166-2849-5ddb-8711-5bb7fe4bf95f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dc7dfb3-0a, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dc7dfb3-0a, col_values=(('qos', UUID('0b6dea41-4586-4b56-ad4c-bb3e684b4c87')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dc7dfb3-0a, col_values=(('external_ids', {'iface-id': '0dc7dfb3-0a86-4bc9-9946-1d47284331ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:15:2a', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a')
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52ef4f9d-6298-51f7-83c1-fc98398017c5', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b53f44b-d9, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b53f44b-d9, col_values=(('qos', UUID('98973e99-0fef-4111-bc68-183cc589bdfc')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b53f44b-d9, col_values=(('external_ids', {'iface-id': '0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:e0:98', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9')
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e5ddf7f-ab6c-5190-8cbf-c966fd1a7f3e', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1075b40b-72, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1075b40b-72, col_values=(('qos', UUID('cc4163b6-7ebc-405a-9527-ce5c55fcd213')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1075b40b-72, col_values=(('external_ids', {'iface-id': '1075b40b-72dd-4cd0-9f92-4df660e297a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:4e:e7', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72')
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bcd3207-2df9-5628-afe1-36c34d942f63', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd962c332-66, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd962c332-66, col_values=(('qos', UUID('f8980212-5ea0-4655-99c9-66c737504ce0')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd962c332-66, col_values=(('external_ids', {'iface-id': 'd962c332-6693-43a2-ba24-a4d39677f1d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:92:38', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66')
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f307716d-a505-5597-a34c-24f629eb5b0a', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62a87f4c-78, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62a87f4c-78, col_values=(('qos', UUID('72277c4b-5022-48a5-b040-bf9b7fe6b994')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62a87f4c-78, col_values=(('external_ids', {'iface-id': '62a87f4c-7859-48e7-b8b6-12f4c716195d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:a4:db', 'vm-uuid': 'd35828f9-195d-4ece-a2d9-db474bc6b581'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:11 user nova-compute[74429]: INFO os_vif [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78')
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] No BDM found with device name hda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] No VIF found with MAC fa:16:3e:5b:9e:18, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] No VIF found with MAC fa:16:3e:0c:4e:e7, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:02:11 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Using config drive
Oct 23 20:02:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:11 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Creating config drive at /opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581/disk.config
Oct 23 20:02:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm7hkebb8 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm7hkebb8" returned: 0 in 0.061s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:12 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:02:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:02:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:02:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-a24e474f-cf99-479e-8572-4c3564471510 req-87901d0b-fd9a-4c09-a1a9-f3d273920203 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a24e474f-cf99-479e-8572-4c3564471510 req-87901d0b-fd9a-4c09-a1a9-f3d273920203 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a24e474f-cf99-479e-8572-4c3564471510 req-87901d0b-fd9a-4c09-a1a9-f3d273920203 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a24e474f-cf99-479e-8572-4c3564471510 req-87901d0b-fd9a-4c09-a1a9-f3d273920203 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-a24e474f-cf99-479e-8572-4c3564471510 req-87901d0b-fd9a-4c09-a1a9-f3d273920203 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:13 user nova-compute[74429]: WARNING nova.compute.manager [req-a24e474f-cf99-479e-8572-4c3564471510 req-87901d0b-fd9a-4c09-a1a9-f3d273920203 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d for instance with vm_state building and task_state spawning.
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-3d62faea-0267-430c-88d0-279fecd5330f req-99006c41-1965-4075-9e1d-1c1ce9072035 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3d62faea-0267-430c-88d0-279fecd5330f req-99006c41-1965-4075-9e1d-1c1ce9072035 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3d62faea-0267-430c-88d0-279fecd5330f req-99006c41-1965-4075-9e1d-1c1ce9072035 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3d62faea-0267-430c-88d0-279fecd5330f req-99006c41-1965-4075-9e1d-1c1ce9072035 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-3d62faea-0267-430c-88d0-279fecd5330f req-99006c41-1965-4075-9e1d-1c1ce9072035 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:14 user nova-compute[74429]: WARNING nova.compute.manager [req-3d62faea-0267-430c-88d0-279fecd5330f req-99006c41-1965-4075-9e1d-1c1ce9072035 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 for instance with vm_state building and task_state spawning.
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ea47e1-743b-4c51-8a6f-c2a62684f7dc req-a66a0763-da86-44a8-a5c3-36f079276c84 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ea47e1-743b-4c51-8a6f-c2a62684f7dc req-a66a0763-da86-44a8-a5c3-36f079276c84 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ea47e1-743b-4c51-8a6f-c2a62684f7dc req-a66a0763-da86-44a8-a5c3-36f079276c84 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ea47e1-743b-4c51-8a6f-c2a62684f7dc req-a66a0763-da86-44a8-a5c3-36f079276c84 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ea47e1-743b-4c51-8a6f-c2a62684f7dc req-a66a0763-da86-44a8-a5c3-36f079276c84 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:14 user nova-compute[74429]: WARNING nova.compute.manager [req-a7ea47e1-743b-4c51-8a6f-c2a62684f7dc req-a66a0763-da86-44a8-a5c3-36f079276c84 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee for instance with vm_state building and task_state spawning.
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-a3b3e0fc-86a0-45fd-b59e-ce2f97aec70e req-899f9c63-0044-4343-8d5d-3d85526a5294 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a3b3e0fc-86a0-45fd-b59e-ce2f97aec70e req-899f9c63-0044-4343-8d5d-3d85526a5294 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a3b3e0fc-86a0-45fd-b59e-ce2f97aec70e req-899f9c63-0044-4343-8d5d-3d85526a5294 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a3b3e0fc-86a0-45fd-b59e-ce2f97aec70e req-899f9c63-0044-4343-8d5d-3d85526a5294 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-a3b3e0fc-86a0-45fd-b59e-ce2f97aec70e req-899f9c63-0044-4343-8d5d-3d85526a5294 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:15 user nova-compute[74429]: WARNING nova.compute.manager [req-a3b3e0fc-86a0-45fd-b59e-ce2f97aec70e req-899f9c63-0044-4343-8d5d-3d85526a5294 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d for instance with vm_state building and task_state spawning.
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-8c11056f-4f0a-4899-84fa-95ed9063d608 req-ef4393a2-5c5e-4791-b6cb-30e3ee48c89b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:16 user nova-compute[74429]: WARNING nova.compute.manager [req-ca071fb0-1f19-4d7f-a39b-be8753df9c55 req-81936452-ddc6-48c9-ac24-38d0080ccf65 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d for instance with vm_state building and task_state spawning.
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:02:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:02:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:02:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance spawned successfully.
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:18 user nova-compute[74429]: INFO nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Took 11.82 seconds to spawn the instance on the hypervisor.
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.375s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:02:18 user nova-compute[74429]: INFO nova.compute.claims [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Claim successful on node user
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:18 user nova-compute[74429]: INFO nova.compute.manager [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Took 71.86 seconds to build instance.
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-25b526f3-fe7b-45da-bfbe-fc73bb2089d4 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 71.973s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.855s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:02:19 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:02:19 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.63974380493164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:19 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.policy [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '734b0b0d04104bfeab582780b77764cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201753405b7c4553af3b39f82311a3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:02:19 user nova-compute[74429]: INFO nova.virt.block_device [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Booting with blank volume at /dev/vda
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 18e01426-64cf-4ca4-90b6-58e17f80242c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d35828f9-195d-4ece-a2d9-db474bc6b581 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:02:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Successfully created port: de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:02:20 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 is timed out.
Oct 23 20:02:20 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Successfully detached device sdc from instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 from the live domain config.
Oct 23 20:02:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOHoMwes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:20 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6ab18-33c8-4fc5-97ab-f1295e11eb57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:02:20 user nova-compute[74429]: No targets found.
Oct 23 20:02:20 user nova-compute[74429]: iSNS:
Oct 23 20:02:20 user nova-compute[74429]: No targets found.
Oct 23 20:02:20 user nova-compute[74429]: STATIC:
Oct 23 20:02:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d
Oct 23 20:02:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c
Oct 23 20:02:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:02:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1
Oct 23 20:02:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:02:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:02:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:20 user nova-compute[74429]: FIRMWARE:
Oct 23 20:02:20 user nova-compute[74429]: No targets found.
Oct 23 20:02:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:02:20 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:02:20 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b397e5-7537-48a3-a504-2c97942e2217]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466f933-560b-4a05-8005-c672e3c7ff79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:20 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50698820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[35191c19-a088-491c-a380-734edeaa2b1c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fe6b08-8605-4574-8d45-84c22976c5ea]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9a3d8-663b-4861-adcd-279de3d4c033]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:02:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa08f2c-d555-4b49-b9ae-baa6d521849f]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a02f23-c8bd-4f88-bfdd-d6057ba0fe6e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15b1e0-ebe4-4d96-82bb-e44e0415a88f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260]
Oct 23 20:02:21 user nova-compute[74429]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:21 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Successfully updated port: de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6211386f-d459-4328-b786-06e7e9dc4d0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cd583b-076c-4462-8440-545d63f3e575]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] <== disconnect_volume: return (397ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquired lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-changed-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Refreshing instance network info cache due to event network-changed-de2fe581-050a-4bab-aec1-15928e24366b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] Acquiring lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Releasing lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance network_info: |[{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] Acquired lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Refreshing network info cache for port de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-changed-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Refreshing instance network info cache due to event network-changed-8b8176bc-f9da-4a7a-a3c1-14a69c90959c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] Acquiring lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] Acquired lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:02:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Refreshing network info cache for port 8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG nova.objects.instance [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lazy-loading 'flavor' on Instance uuid fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bd53d063-2d75-4995-ba80-a8be18062b6f tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.945s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updated VIF entry in instance network info cache for port de2fe581-050a-4bab-aec1-15928e24366b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-213e1390-f4ca-4671-9980-577568527ed7 req-5819ceff-e5b3-4be3-a20e-20a283975eb2 service nova] Releasing lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updated VIF entry in instance network info cache for port 8b8176bc-f9da-4a7a-a3c1-14a69c90959c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updating instance_info_cache with network_info: [{"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e18bef4-114f-4535-a4ca-f5478bb2f20b req-019a17e8-b4cd-4cdd-ba0f-8ae042789efa service nova] Releasing lock "refresh_cache-18e01426-64cf-4ca4-90b6-58e17f80242c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:22 user nova-compute[74429]: INFO nova.compute.manager [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Terminating instance
Oct 23 20:02:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e0b23b05-b34a-4175-90c2-3f87256a2598 req-4eb97d0f-a350-40ef-a1b4-c6f07453c7fb service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-unplugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e0b23b05-b34a-4175-90c2-3f87256a2598 req-4eb97d0f-a350-40ef-a1b4-c6f07453c7fb service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e0b23b05-b34a-4175-90c2-3f87256a2598 req-4eb97d0f-a350-40ef-a1b4-c6f07453c7fb service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e0b23b05-b34a-4175-90c2-3f87256a2598 req-4eb97d0f-a350-40ef-a1b4-c6f07453c7fb service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e0b23b05-b34a-4175-90c2-3f87256a2598 req-4eb97d0f-a350-40ef-a1b4-c6f07453c7fb service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-unplugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e0b23b05-b34a-4175-90c2-3f87256a2598 req-4eb97d0f-a350-40ef-a1b4-c6f07453c7fb service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-unplugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:02:23 user nova-compute[74429]: INFO nova.compute.manager [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Rebuilding instance
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Instance destroyed successfully.
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lazy-loading 'resources' on Instance uuid fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T19:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1500447609',display_name='tempest-AttachSCSIVolumeTestJSON-server-1500447609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1500447609',id=5,image_ref='4173a61a-278c-4170-b621-3855a804c821',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMElNpI/79AWwXCrpr3ouI39UOLj+tfq58hLhbQlMtCru40mV/P1eYpfckJvkrCV+OXCEK1t8HgU5Yrb7noQW2O5qgfpEOfkzFLJCZ7dTW78/8OvINBTi7iPT0V5fjr4gA==',key_name='tempest-keypair-929672768',keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e03ae34326de4865a98b9260d44c7913',ramdisk_id='',reservation_id='r-50oiffp0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4173a61a-278c-4170-b621-3855a804c821',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1074995272',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1074995272-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T19:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a8f83b6a214c23ac062b7e0a59ab95',uuid=fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Converting VIF {"id": "1dea4302-ed87-4c99-9089-e02dae437431", "address": "fa:16:3e:54:d1:e1", "network": {"id": "2b52743a-d997-42b6-b470-050a612b9497", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1934934315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e03ae34326de4865a98b9260d44c7913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dea4302-ed", "ovs_interfaceid": "1dea4302-ed87-4c99-9089-e02dae437431", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG os_vif [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dea4302-ed, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37629964-5370-481a-a1f1-fd41b24db6d3) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:23 user nova-compute[74429]: INFO os_vif [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d1:e1,bridge_name='br-int',has_traffic_filtering=True,id=1dea4302-ed87-4c99-9089-e02dae437431,network=Network(2b52743a-d997-42b6-b470-050a612b9497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dea4302-ed')
Oct 23 20:02:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Deleting instance files /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5_del
Oct 23 20:02:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Deletion of /opt/stack/data/nova/instances/fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5_del complete
Oct 23 20:02:24 user nova-compute[74429]: INFO nova.compute.manager [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-b8815274-c3c9-473c-b19e-be657d69e43a req-89fa9b4d-b04a-464a-9ca9-534211bd273d service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-unplugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b8815274-c3c9-473c-b19e-be657d69e43a req-89fa9b4d-b04a-464a-9ca9-534211bd273d service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b8815274-c3c9-473c-b19e-be657d69e43a req-89fa9b4d-b04a-464a-9ca9-534211bd273d service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b8815274-c3c9-473c-b19e-be657d69e43a req-89fa9b4d-b04a-464a-9ca9-534211bd273d service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-b8815274-c3c9-473c-b19e-be657d69e43a req-89fa9b4d-b04a-464a-9ca9-534211bd273d service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-unplugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:24 user nova-compute[74429]: WARNING nova.compute.manager [req-b8815274-c3c9-473c-b19e-be657d69e43a req-89fa9b4d-b04a-464a-9ca9-534211bd273d service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-unplugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state active and task_state rebuilding.
Oct 23 20:02:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance destroyed successfully.
Oct 23 20:02:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance destroyed successfully.
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-234378906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-21309619',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYaIxZ7haGHQMD2Sc8iBoGdZU3kvelcOBgu+qFikPLl+VRRGeDnKWY3kG8gozWbDIfd0wVL3Fo7n6yEXtY6YFq0e1EKglNJL7sWOSRs01CeH9d99XcJG2Pv5Mb2uI6tQ==',key_name='tempest-keypair-40106845',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b589e45483454d7a90358486b8226198',ramdisk_id='',reservation_id='r-c80lshri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1521560130',owner_user_name='tempest-ServerActionsV293TestJSON-1521560130-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4f293bc56648d1a664c7487f868607',uuid=18e01426-64cf-4ca4-90b6-58e17f80242c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converting VIF {"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8176bc-f9, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec4f7928-987b-4d4b-bd6d-31a84e94d4fb) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:02:24 user nova-compute[74429]: INFO os_vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9')
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:24 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a343821-673c-4235-89df-f06527ce1dd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:02:24 user nova-compute[74429]: No targets found.
Oct 23 20:02:24 user nova-compute[74429]: iSNS:
Oct 23 20:02:24 user nova-compute[74429]: No targets found.
Oct 23 20:02:24 user nova-compute[74429]: STATIC:
Oct 23 20:02:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d
Oct 23 20:02:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:02:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1
Oct 23 20:02:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:02:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:02:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:24 user nova-compute[74429]: FIRMWARE:
Oct 23 20:02:24 user nova-compute[74429]: No targets found.
Oct 23 20:02:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:02:24 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:02:24 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefe7271-3029-4d3f-8256-4371d4110c05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca981b-c63a-4045-bea1-4a1338c58f10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:24 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50670310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5894042b-b342-4ae3-97df-4b547679e3cb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcde3455-1f0f-46eb-9da3-cd55cb10c783]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc388d22-fd33-49e9-a18c-032d28817bb9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbe9439-4ea4-47fc-9444-5778099e754f]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObb0c16c4-47affd33392bd9fa', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bb0c16c4', '/dev/disk/by-id/scsi-23437616666643333') {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[11486300-1c5f-4841-be90-d08ce3d8cd87]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6d293-c505-491d-ac5a-db231ab2d2b8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c717339-6371-4c47-97bd-d1507453d9a3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]
Oct 23 20:02:24 user nova-compute[74429]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4905650d-71c3-48c3-b5d5-f3ff6b77d4e6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== disconnect_volume: return (411ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:02:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Deleting instance files /opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c_del
Oct 23 20:02:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Deletion of /opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c_del complete
Oct 23 20:02:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 18e01426-64cf-4ca4-90b6-58e17f80242c could not be found.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:25 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdb0f0a-d4ae-44b9-ae1b-e74667fdb218]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:02:25 user nova-compute[74429]: No targets found.
Oct 23 20:02:25 user nova-compute[74429]: iSNS:
Oct 23 20:02:25 user nova-compute[74429]: No targets found.
Oct 23 20:02:25 user nova-compute[74429]: STATIC:
Oct 23 20:02:25 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d
Oct 23 20:02:25 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:25 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:25 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:02:25 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:25 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:25 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1
Oct 23 20:02:25 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:25 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:25 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:02:25 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:25 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:25 user nova-compute[74429]: FIRMWARE:
Oct 23 20:02:25 user nova-compute[74429]: No targets found.
Oct 23 20:02:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:02:25 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:02:25 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[25517d13-f7c4-4495-b917-15d9cfcef8c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ef3a1-c83a-4920-8865-353395accfdf]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:25 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:25 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:25 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:25 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:25 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:25 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50698ca0>, {}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Disconnecting from: [] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== disconnect_volume: return (99ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:25 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Took 1.17 seconds to deallocate network for instance.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:25 user nova-compute[74429]: WARNING nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state deleted and task_state None.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:25 user nova-compute[74429]: WARNING nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state deleted and task_state None.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:25 user nova-compute[74429]: WARNING nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state deleted and task_state None.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-unplugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-unplugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:25 user nova-compute[74429]: WARNING nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-unplugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state deleted and task_state None.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Acquiring lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] No waiting events found dispatching network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:25 user nova-compute[74429]: WARNING nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received unexpected event network-vif-plugged-1dea4302-ed87-4c99-9089-e02dae437431 for instance with vm_state deleted and task_state None.
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-0d3283ef-7e5e-4714-be28-1ab34c3694e3 req-6420231b-3a7c-480e-8084-b5d9834cb610 service nova] [instance: fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5] Received event network-vif-deleted-1dea4302-ed87-4c99-9089-e02dae437431 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:25 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Deleted allocations for instance fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5
Oct 23 20:02:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63851a10-761c-4fbe-8da9-d6897aecc444 tempest-AttachSCSIVolumeTestJSON-1074995272 tempest-AttachSCSIVolumeTestJSON-1074995272-project-member] Lock "fe059ce0-2a4f-44b3-8ad1-66fc1fa854f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.805s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-278d9e47-96fb-4e7a-a07a-3012496583ac req-be4350b6-eda1-400c-98fc-86afb3c31ca2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-278d9e47-96fb-4e7a-a07a-3012496583ac req-be4350b6-eda1-400c-98fc-86afb3c31ca2 service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-278d9e47-96fb-4e7a-a07a-3012496583ac req-be4350b6-eda1-400c-98fc-86afb3c31ca2 service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-278d9e47-96fb-4e7a-a07a-3012496583ac req-be4350b6-eda1-400c-98fc-86afb3c31ca2 service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-278d9e47-96fb-4e7a-a07a-3012496583ac req-be4350b6-eda1-400c-98fc-86afb3c31ca2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:02:26 user nova-compute[74429]: WARNING nova.compute.manager [req-278d9e47-96fb-4e7a-a07a-3012496583ac req-be4350b6-eda1-400c-98fc-86afb3c31ca2 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state active and task_state rebuilding.
Oct 23 20:02:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Preparing to wait for external event volume-reimaged-e05e591c-4315-4349-8f87-450ba1215d64 {{(pid=74429) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 is timed out.
Oct 23 20:02:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Successfully detached device vdb from instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 from the live domain config.
Oct 23 20:02:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NJqOWCeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:28 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a1ee59-af29-49b3-a66d-4d3aa66076a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:02:28 user nova-compute[74429]: No targets found.
Oct 23 20:02:28 user nova-compute[74429]: iSNS:
Oct 23 20:02:28 user nova-compute[74429]: No targets found.
Oct 23 20:02:28 user nova-compute[74429]: STATIC:
Oct 23 20:02:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d
Oct 23 20:02:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:02:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1
Oct 23 20:02:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:02:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:02:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:02:28 user nova-compute[74429]: FIRMWARE:
Oct 23 20:02:28 user nova-compute[74429]: No targets found.
Oct 23 20:02:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:02:28 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:02:28 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184ded2-06be-4519-992f-d0b78a7e0274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd19cbd-de85-4980-9514-8e9b4711a772]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:28 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:28 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:28 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d (non-flash)
Oct 23 20:02:28 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:28 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:28 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5057cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2812c2ad-b1c9-4115-8074-ebd9d6d67303]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[df735f16-4b70-4744-a1ea-e3e7f3ffe4e1]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38ac53-585a-4ec5-9319-ddeada125c0c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6749550-72bd-4a7a-a757-cc70f55f2004]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63f3a79-3a02-41a2-b044-94987a44dd86]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e70fa6-12fc-4fcc-b9b4-2729493bbea5]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260]
Oct 23 20:02:29 user nova-compute[74429]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d1c0cd4-9a8b-4cb1-8a4c-d33fcb71f52d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca6e9c4-eb52-41e7-8b82-7d016102c4ff]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] <== disconnect_volume: return (349ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:02:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:31 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lazy-loading 'flavor' on Instance uuid a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ccc887b1-52e9-41a4-be22-095f2a06468f tempest-VolumesAssistedSnapshotsTest-350001251 tempest-VolumesAssistedSnapshotsTest-350001251-project-admin] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.597s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG os_brick.utils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f797299-3786-430d-bb5f-10d61862db4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a52f4ce-1ad2-4d79-bab6-2a6b34fe6312]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5897587c-465f-45c1-a28f-26959a40783b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbbaeaa-3a2a-48a1-aba2-29707eb4aa8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:35 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:02:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f1c2a-e676-412b-a010-15d24ec9f414]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG os_brick.utils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:35 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating existing volume attachment record: be0fd16f-4bbb-4ffe-bafa-96a0b69358f5 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:02:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:38 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:38 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:02:38 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff07cfe-0d91-45c9-9ac3-f9179facd951]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:02:38 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1368cef0-64fd-4e19-b35e-efe3871d9ff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328] added
Oct 23 20:02:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b734b1-2d83-43eb-8525-a97c8aa4c8dc]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd2ee80-f91e-4afb-9c59-2faa749004ad]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yitSuaUo {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yitSuaUo" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d7695-d8d7-45f4-857b-3ce9f6edfb58]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yitSuaUo'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadb7213-ba98-4622-a7d5-c8d73dc2595d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c474ade8-4192-42de-8488-327f9a7dd58e]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf03e940-71e5-47be-bde7-844e9bb67280]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]
Oct 23 20:02:38 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.
Oct 23 20:02:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46415c4-48da-4404-83f1-a754292f3bef]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea4421b-274f-4ee5-a9f7-73aa9d5ebbf2]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:02:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f790ac8-d254-43cc-ab5e-7a7ec7609a50]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23633353630393235', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633353630393235', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:02:39 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lazy-loading 'flavor' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:02:40 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:02:40 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:02:40 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:02:40 user nova-compute[74429]:   <serial>252d8f78-24fa-45e4-a44f-8676d9b67328</serial>
Oct 23 20:02:40 user nova-compute[74429]: </disk>
Oct 23 20:02:40 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:02:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:02:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:02:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] No VIF found with MAC fa:16:3e:c3:27:8e, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:02:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f1f5ea30-f404-4b61-832c-47b57d796a9c tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.778s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG os_brick.utils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099190e-5447-4b7f-bb7b-dc4fd9c5bbd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f153557-a702-4bf7-9062-dddf0d474e5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a52926f-df25-40b2-9e7a-8f9ce25071ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83c18bd-5ea4-4d73-b03d-96308d69b901]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:42 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:02:42 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988c4dc-165a-4b7b-b6ac-d42e2a5c06de]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:02:42 user nova-compute[74429]: DEBUG os_brick.utils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:42 user nova-compute[74429]: INFO nova.compute.manager [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Swapping volume 252d8f78-24fa-45e4-a44f-8676d9b67328 for d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:02:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received event network-changed-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Refreshing instance network info cache due to event network-changed-3787f163-ec13-4032-a8b6-22b3ba8266d0. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] Acquiring lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] Acquired lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Refreshing network info cache for port 3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updated VIF entry in instance network info cache for port 3787f163-ec13-4032-a8b6-22b3ba8266d0. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating instance_info_cache with network_info: [{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fa054d95-c9b1-44ea-ab50-37b30210676a req-6cac63d1-3c45-483c-98d4-43821ec4c5b2 service nova] Releasing lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG nova.objects.instance [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'flavor' on Instance uuid 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:02:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:02:48 user nova-compute[74429]: INFO nova.compute.manager [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Attaching volume 69718eb6-5d31-4c12-a393-59513be2757a to /dev/vdb
Oct 23 20:02:48 user nova-compute[74429]: DEBUG os_brick.utils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c5937-330d-4e77-b344-c8fc1f48b402]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e657f4-b154-4c9e-b52d-cc6f7f5bfb09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1189122a-4e97-48c2-9c90-8474f00f7a6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9749db4-df52-4b1b-8b06-7e1b53b805a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:02:48 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:02:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b15957-0689-4c13-9c8f-f9891573424e]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG os_brick.utils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:02:48 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating existing volume attachment record: cc6305a8-2c68-4d98-8b10-f37762a2dec8 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:02:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:02:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcTwnEjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a41ae88-9f6c-47c4-a7d5-e2501228b313', 'attached_at': '', 'detached_at': '', 'volume_id': 'd465c885-efdd-4eca-8338-0c6cf285c21a', 'serial': 'd465c885-efdd-4eca-8338-0c6cf285c21a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1a41ae88-9f6c-47c4-a7d5-e2501228b313', 'attached_at': '', 'detached_at': '', 'volume_id': '252d8f78-24fa-45e4-a44f-8676d9b67328', 'serial'} {{(pid=74429) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcTwnEjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:02 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:02 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:02 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[769af7f9-1d67-48de-a78c-3a5e583030db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:03:02 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b9845-e4a0-476f-95d3-c7f1c83f55df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a] added
Oct 23 20:03:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c022f2ad-72d2-4c9a-9fde-9e4486421dee]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db72c6-df0c-4cd5-af56-782bd9bcead0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcTwnEjJ {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcTwnEjJ" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f0f6a-3a9f-4adc-b8d1-eafb23a56d21]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcTwnEjJ'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e41ed-7137-422e-8bd0-475f9257e9f8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5f976a-7562-4355-9177-845fbf3eb6cb]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eeba3a-f854-47ff-98aa-6a7a5edc038a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260]
Oct 23 20:03:02 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ab45f-a604-4edd-96b3-5c417db4df9c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[699c1553-c019-4840-b633-3cae15a427f5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:03:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[729db5a1-68ee-4ff8-90a1-6fd5b7e2e726]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:03:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcTwnEjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:03:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23239386534353864', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239386534353864', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:03:03 user nova-compute[74429]: DEBUG nova.objects.instance [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lazy-loading 'flavor' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 173015040 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 447741952 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 531628032 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 676331520 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 848297984 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 1006632960 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG nova.objects.instance [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'flavor' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:08 user nova-compute[74429]: INFO nova.compute.manager [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Attaching volume 12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd to /dev/vdb
Oct 23 20:03:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:08 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff02271d-0ed3-4a5f-9cee-c24a02a5877a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:03:08 user nova-compute[74429]: No targets found.
Oct 23 20:03:08 user nova-compute[74429]: iSNS:
Oct 23 20:03:08 user nova-compute[74429]: No targets found.
Oct 23 20:03:08 user nova-compute[74429]: STATIC:
Oct 23 20:03:08 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:03:08 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:08 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:08 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:03:08 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:08 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:08 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:03:08 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:08 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:08 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1
Oct 23 20:03:08 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:08 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:08 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:03:08 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:08 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:08 user nova-compute[74429]: FIRMWARE:
Oct 23 20:03:08 user nova-compute[74429]: No targets found.
Oct 23 20:03:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:03:08 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:03:08 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb1fc0-e4d1-4ab9-9b97-220b360e71d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.utils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5ed7f7-ca51-4679-94ea-71164190a563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97c00c-4dd1-4829-ad9e-c434e90f38c2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:03:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:08 user nova-compute[74429]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:03:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580b39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c3dae-179c-4cb7-9232-a9da25080c41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41e8f4-566c-4a13-aa65-51a2bf84b219]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbd7bed-5395-404e-8677-002a59897385]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12ed40-912c-4040-a022-8c8e65625421]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[885dc0a5-59d7-405a-97c7-501bfe626fbf]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:08 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff477ed7-9ba2-4ae9-a228-bab8c76088b6]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.utils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating existing volume attachment record: e604dc92-1397-4ddf-b96a-df300998c27e {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d8327-9d70-4066-abb6-8df6238d2e47]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffb7317-52e1-4105-9106-5a4cbf584d63]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[58232869-2375-41bb-9fc9-281fbad84ed7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ecb69-d3b7-483c-9dfb-0058f0a8d540]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]
Oct 23 20:03:08 user nova-compute[74429]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69a144-50c5-4fa6-a02d-a427f418afba]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] <== disconnect_volume: return (406ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:03:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:12 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:03:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:03:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:03:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:03:13 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:03:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:03:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-79258094-ca95-4a88-a8f2-c24ebf3fa439 req-c77758b4-4d44-43ef-b4c9-8e23314147ac service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event volume-reimaged-e05e591c-4315-4349-8f87-450ba1215d64 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-79258094-ca95-4a88-a8f2-c24ebf3fa439 req-c77758b4-4d44-43ef-b4c9-8e23314147ac service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-79258094-ca95-4a88-a8f2-c24ebf3fa439 req-c77758b4-4d44-43ef-b4c9-8e23314147ac service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-79258094-ca95-4a88-a8f2-c24ebf3fa439 req-c77758b4-4d44-43ef-b4c9-8e23314147ac service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-79258094-ca95-4a88-a8f2-c24ebf3fa439 req-c77758b4-4d44-43ef-b4c9-8e23314147ac service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Processing event volume-reimaged-e05e591c-4315-4349-8f87-450ba1215d64 {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance event wait completed in 51 seconds for volume-reimaged {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:03:17 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:03:17 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:03:17 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7866MB free_disk=25.67803955078125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:17 user nova-compute[74429]: INFO nova.virt.block_device [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Booting with volume e05e591c-4315-4349-8f87-450ba1215d64 at /dev/vda
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6d3a4b5-09f8-4c00-bec0-3793752ead25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 18e01426-64cf-4ca4-90b6-58e17f80242c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d35828f9-195d-4ece-a2d9-db474bc6b581 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:03:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:03:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzESxjRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:27 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:27 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:27 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba2f8c-ea85-4f4c-8968-3fde1982cf1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:03:27 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6877b66-7897-4985-a6d4-97ca25226634]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd] added
Oct 23 20:03:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c1b4a-6d1d-4970-9a30-440dded9bdfd]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0730dcb-361a-4b99-b6b5-e46eb425dafe]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzESxjRI {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcTwnEjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1a41ae88-9f6c-47c4-a7d5-e2501228b313', 'attached_at': '', 'detached_at': '', 'volume_id': 'd465c885-efdd-4eca-8338-0c6cf285c21a', 'serial'} {{(pid=74429) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] swap_volume: removing Cinder connection for volume 252d8f78-24fa-45e4-a44f-8676d9b67328 {{(pid=74429) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzESxjRI" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a6efa-2ed7-4008-8139-f5d7c8e05e19]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mzESxjRI'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8539911-38a1-4aee-8260-8e169082afb6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e4f19-2286-43c8-b632-0803f6fe5183]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[852bfbe9-a240-4392-b07a-5d72bc19ae68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260]
Oct 23 20:03:27 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab9191-34ab-4592-804c-7794c0119a05]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323ffde-2bec-44ae-a6b4-d12bbd1d66d8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:27 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc95f65b-083a-409b-ab4d-e8e7108e355e]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzESxjRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:27 user nova-compute[74429]: INFO nova.compute.manager [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Terminating instance
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-d9d3cf68-df40-41d9-b1ca-ffb0d3df85ac req-d479dd08-5477-4c29-859a-e490cc487e5b service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-vif-unplugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d9d3cf68-df40-41d9-b1ca-ffb0d3df85ac req-d479dd08-5477-4c29-859a-e490cc487e5b service nova] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d9d3cf68-df40-41d9-b1ca-ffb0d3df85ac req-d479dd08-5477-4c29-859a-e490cc487e5b service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d9d3cf68-df40-41d9-b1ca-ffb0d3df85ac req-d479dd08-5477-4c29-859a-e490cc487e5b service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-d9d3cf68-df40-41d9-b1ca-ffb0d3df85ac req-d479dd08-5477-4c29-859a-e490cc487e5b service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] No waiting events found dispatching network-vif-unplugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-d9d3cf68-df40-41d9-b1ca-ffb0d3df85ac req-d479dd08-5477-4c29-859a-e490cc487e5b service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-vif-unplugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Instance destroyed successfully.
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lazy-loading 'resources' on Instance uuid a6d3a4b5-09f8-4c00-bec0-3793752ead25 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1054268787',display_name='tempest-VolumesAssistedSnapshotsTest-server-1054268787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1054268787',id=6,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP45RfA18JxQT3319hvF7dAg2JUJc9F8rsqSVyN4t3oCU0Aw7+cqVM9Zm7ULcw4d9s2Eo8L+MjUIja4wHCMhikb/nGMYI/xl7ZrmWQVK1vmqsYDkxnDy6OkYylJplxD5Wg==',key_name='tempest-keypair-1557373838',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d5e323297d14a1fbb5e36ef9f4abd46',ramdisk_id='',reservation_id='r-v3c20j4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-998593369',owner_user_name='tempest-VolumesAssistedSnapshotsTest-998593369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e9d9096ebb5499e834d7f7156c7c578',uuid=a6d3a4b5-09f8-4c00-bec0-3793752ead25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Converting VIF {"id": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "address": "fa:16:3e:6d:50:3b", "network": {"id": "efe23a56-d5fa-479c-a406-e29a921a8a87", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-994038734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d5e323297d14a1fbb5e36ef9f4abd46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f4b61ff-cd", "ovs_interfaceid": "9f4b61ff-cd8d-4d17-ba69-45c15de516b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_vif [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f4b61ff-cd, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9638ec8-91eb-445c-85de-a5958c2d3ae6) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:28 user nova-compute[74429]: INFO os_vif [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:50:3b,bridge_name='br-int',has_traffic_filtering=True,id=9f4b61ff-cd8d-4d17-ba69-45c15de516b7,network=Network(efe23a56-d5fa-479c-a406-e29a921a8a87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f4b61ff-cd')
Oct 23 20:03:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Deleting instance files /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25_del
Oct 23 20:03:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Deletion of /opt/stack/data/nova/instances/a6d3a4b5-09f8-4c00-bec0-3793752ead25_del complete
Oct 23 20:03:28 user nova-compute[74429]: INFO nova.compute.manager [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26363656236363136', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363656236363136', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] swap_volume: Updating volume 252d8f78-24fa-45e4-a44f-8676d9b67328 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dcTwnEjJ", "auth_password": "P25sMoVAzu8mLg", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "d465c885-efdd-4eca-8338-0c6cf285c21a"}, "status": "reserved", "instance": "1a41ae88-9f6c-47c4-a7d5-e2501228b313", "attached_at": "", "detached_at": "", "volume_id": "d465c885-efdd-4eca-8338-0c6cf285c21a", "serial": "d465c885-efdd-4eca-8338-0c6cf285c21a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd465c885-efdd-4eca-8338-0c6cf285c21a', 'no_device': None, 'attachment_id': 'ee9d6a64-067e-4fe5-b3bf-e3d4411969b4'} {{(pid=74429) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'flavor' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfab0d1e-79a5-45db-8994-6538c327cac0 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 46.503s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:03:28 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:28 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:03:28 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:03:28 user nova-compute[74429]:   <serial>12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd</serial>
Oct 23 20:03:28 user nova-compute[74429]: </disk>
Oct 23 20:03:28 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.utils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e81a1b-79ca-47b5-b383-2656f9d31718]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7c4925-6e9d-45a6-8c81-81fbd245f07c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6639885-df59-4a9e-ace5-37cad1ae2576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[346f570c-2f37-4549-81ea-36f89247d606]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'flavor' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:28 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[23340d34-aa14-4543-96fc-04739a162d74]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG os_brick.utils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updating existing volume attachment record: 5687026c-e2aa-4dcd-86bc-f5b52364902a {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No VIF found with MAC fa:16:3e:00:37:0d, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:03:29 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Took 0.83 seconds to deallocate network for instance.
Oct 23 20:03:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-2440d5e4-65d4-4e42-8d1e-3ad932d4c1fa req-999bd328-b970-40eb-ae6a-518cc2813fac service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-vif-deleted-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:29 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Deleted allocations for instance a6d3a4b5-09f8-4c00-bec0-3793752ead25
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a38565b8-3de9-43b9-b146-a90c7c7e29b3 tempest-VolumesAssistedSnapshotsTest-998593369 tempest-VolumesAssistedSnapshotsTest-998593369-project-member] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-f0ca31d6-8357-4581-bcc0-695197908c14 req-ec8433f4-4cde-402a-b30e-581c06f05546 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received event network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f0ca31d6-8357-4581-bcc0-695197908c14 req-ec8433f4-4cde-402a-b30e-581c06f05546 service nova] Acquiring lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f0ca31d6-8357-4581-bcc0-695197908c14 req-ec8433f4-4cde-402a-b30e-581c06f05546 service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f0ca31d6-8357-4581-bcc0-695197908c14 req-ec8433f4-4cde-402a-b30e-581c06f05546 service nova] Lock "a6d3a4b5-09f8-4c00-bec0-3793752ead25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-f0ca31d6-8357-4581-bcc0-695197908c14 req-ec8433f4-4cde-402a-b30e-581c06f05546 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] No waiting events found dispatching network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:29 user nova-compute[74429]: WARNING nova.compute.manager [req-f0ca31d6-8357-4581-bcc0-695197908c14 req-ec8433f4-4cde-402a-b30e-581c06f05546 service nova] [instance: a6d3a4b5-09f8-4c00-bec0-3793752ead25] Received unexpected event network-vif-plugged-9f4b61ff-cd8d-4d17-ba69-45c15de516b7 for instance with vm_state deleted and task_state None.
Oct 23 20:03:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:03:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:03:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:03:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1df66ca5-b5e8-49fd-bdaa-1128f835c81b tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.598s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pORQfzNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:48 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2002f7-1bfe-46a4-80a1-40619a57634d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:03:48 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[19608271-56f1-4fe5-b4ba-9d357920522a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a] added
Oct 23 20:03:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8d9911-e62a-4518-bd8c-db93669d3cc7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[10369b58-1b48-4a0e-ac85-3ed7f1209ea1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pORQfzNh {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:48 user nova-compute[74429]: INFO nova.compute.manager [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Attaching volume c7ff430d-b88f-48f3-81c0-888a3f5c75d0 to /dev/vdb
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:03:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Creating image(s)
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Ensure instance console log exists: /opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Start _get_guest_xml network_info=[{"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '5687026c-e2aa-4dcd-86bc-f5b52364902a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18e01426-64cf-4ca4-90b6-58e17f80242c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e05e591c-4315-4349-8f87-450ba1215d64', 'serial': 'e05e591c-4315-4349-8f87-450ba1215d64'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pORQfzNh" returned: 0 in 0.045s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[806bd2c0-2783-41e0-9cfd-4b270815695f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pORQfzNh'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 20:03:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.objects.instance [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18e01426-64cf-4ca4-90b6-58e17f80242c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74ecbc8-d971-48bc-8e05-d039e4f09273]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d68bc3-f8c1-4acc-871a-a95be7e6598b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:03:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Creating image(s)
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Ensure instance console log exists: /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Start _get_guest_xml network_info=[{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'be0fd16f-4bbb-4ffe-bafa-96a0b69358f5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9901998c-ee34-4de9-b819-bc6c23bdfcdd', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'serial': 'ee7fb1f1-09e6-457f-8f31-1c3aff0a5658'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:03:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.utils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae7e34c-6572-4c4c-b567-6f20182c6b32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[121ee652-8847-4136-904b-b57ad2b64983]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260]
Oct 23 20:03:48 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c71b67c-b3c9-4fd9-b8ac-6c93f4147ed2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8043e0-bda6-4e32-b532-3b7a4466e4df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a8ea65-82ef-4956-889a-c288a492f629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f39287-7602-4869-896f-5a41338067fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c507733-ba27-4754-a2f3-cb73dd81abfb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:48 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.505s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.utils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:48 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9c9305-79a6-4276-864a-b88bef69af7a]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff425d5c-1c47-4a65-9d26-d9d97b093b2e]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ab01e-3f7a-4010-a538-d2bd67b27723]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pORQfzNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG os_brick.utils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== get_connector_properties: return (247ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating existing volume attachment record: e848746c-29d6-4c84-8342-f05c2853023d {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e79771-7fde-4bb7-ba01-2ca97e90620b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec80e274-35b0-4623-a368-908721febb5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd4c3e-f36d-4322-9f9c-526186bd0130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:03:49 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9e249d-8c5f-4246-9e3c-80446e6b412d]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.utils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:49 user nova-compute[74429]: INFO nova.compute.manager [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Swapping volume d465c885-efdd-4eca-8338-0c6cf285c21a for 252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-changed-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing instance network info cache due to event network-changed-5fd49d73-8202-45c2-bce0-af9878f2f69d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] Acquiring lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] Acquired lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Refreshing network info cache for port 5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:03:49 user nova-compute[74429]: INFO nova.compute.manager [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Rescuing
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.595s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] <== connect_volume: return (1597ms) {'type': 'block', 'scsi_wwn': '26430316139313961', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430316139313961', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.325s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:49 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:49 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.objects.instance [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'flavor' on Instance uuid 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039f278-2574-47f6-a89a-eb2494850527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:03:49 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:03:49 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:49 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:03:49 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:03:49 user nova-compute[74429]:   <serial>69718eb6-5d31-4c12-a393-59513be2757a</serial>
Oct 23 20:03:49 user nova-compute[74429]: </disk>
Oct 23 20:03:49 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4972b8-8fa8-476c-86e3-7ab84dc97e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64] added
Oct 23 20:03:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb00af8-4b7c-43f2-8912-3ceec9d2b627]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[547914d5-a67a-4f44-889e-95e7ece337c0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRJdQBFn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRJdQBFn" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[318c11db-810b-494c-9ac3-fc34d396a75b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRJdQBFn'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3839caea-30b3-4687-8b1a-42efe9ad85d3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91a09b6-606a-4551-aa19-bc9f4dda7bad]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.233s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e88da7-1ca4-495b-ba3b-bf39deb15ff3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]
Oct 23 20:03:50 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a541a-78d2-49e1-a098-6bbd5d8884c2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f824700-5dce-46b8-af14-3472c1a7ed85]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:50 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.534s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No VIF found with MAC fa:16:3e:be:cb:dc, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff90e88-fd6f-46db-9d88-e3187f1b7357]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-683bbff5-980a-4041-ad40-74af134d3e25 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 62.397s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updated VIF entry in instance network info cache for port 5fd49d73-8202-45c2-bce0-af9878f2f69d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [{"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9faa25a3-a032-4037-bdc3-ef0d66215625 req-4d7b8b25-44ef-4c77-9b4d-67beb5a9cd6a service nova] Releasing lock "refresh_cache-d35828f9-195d-4ece-a2d9-db474bc6b581" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-98913721-0d3d-472a-81b2-146006597e11 req-6303e180-73a5-49e1-b3f7-6c9c6e2a01bf service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-98913721-0d3d-472a-81b2-146006597e11 req-6303e180-73a5-49e1-b3f7-6c9c6e2a01bf service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-98913721-0d3d-472a-81b2-146006597e11 req-6303e180-73a5-49e1-b3f7-6c9c6e2a01bf service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-98913721-0d3d-472a-81b2-146006597e11 req-6303e180-73a5-49e1-b3f7-6c9c6e2a01bf service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-98913721-0d3d-472a-81b2-146006597e11 req-6303e180-73a5-49e1-b3f7-6c9c6e2a01bf service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:51 user nova-compute[74429]: WARNING nova.compute.manager [req-98913721-0d3d-472a-81b2-146006597e11 req-6303e180-73a5-49e1-b3f7-6c9c6e2a01bf service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state rescuing.
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.577s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== connect_volume: return (2902ms) {'type': 'block', 'scsi_wwn': '23437616666643333', 'path': '/dev/sdh'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437616666643333', 'path': '/dev/sdh'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.838s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:51 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007931f-884e-46eb-b69b-7219631970c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:03:51 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-234378906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-21309619',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYaIxZ7haGHQMD2Sc8iBoGdZU3kvelcOBgu+qFikPLl+VRRGeDnKWY3kG8gozWbDIfd0wVL3Fo7n6yEXtY6YFq0e1EKglNJL7sWOSRs01CeH9d99XcJG2Pv5Mb2uI6tQ==',key_name='tempest-keypair-40106845',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b589e45483454d7a90358486b8226198',ramdisk_id='',reservation_id='r-c80lshri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1521560130',owner_user_name='tempest-ServerActionsV293TestJSON-1521560130-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4f293bc56648d1a664c7487f868607',uuid=18e01426-64cf-4ca4-90b6-58e17f80242c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converting VIF {"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:03:51 user nova-compute[74429]:   <uuid>18e01426-64cf-4ca4-90b6-58e17f80242c</uuid>
Oct 23 20:03:51 user nova-compute[74429]:   <name>instance-00000008</name>
Oct 23 20:03:51 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:03:51 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:03:51 user nova-compute[74429]:   <metadata>
Oct 23 20:03:51 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:03:51 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:03:51 user nova-compute[74429]:       <nova:name>tempest-ServerActionsV293TestJSON-server-234378906</nova:name>
Oct 23 20:03:51 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:03:48</nova:creationTime>
Oct 23 20:03:51 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:03:51 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:03:51 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:03:51 user nova-compute[74429]:       <nova:owner>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:user uuid="fb4f293bc56648d1a664c7487f868607">tempest-ServerActionsV293TestJSON-1521560130-project-member</nova:user>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:project uuid="b589e45483454d7a90358486b8226198">tempest-ServerActionsV293TestJSON-1521560130</nova:project>
Oct 23 20:03:51 user nova-compute[74429]:       </nova:owner>
Oct 23 20:03:51 user nova-compute[74429]:       <nova:ports>
Oct 23 20:03:51 user nova-compute[74429]:         <nova:port uuid="8b8176bc-f9da-4a7a-a3c1-14a69c90959c">
Oct 23 20:03:51 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:03:51 user nova-compute[74429]:         </nova:port>
Oct 23 20:03:51 user nova-compute[74429]:       </nova:ports>
Oct 23 20:03:51 user nova-compute[74429]:     </nova:instance>
Oct 23 20:03:51 user nova-compute[74429]:   </metadata>
Oct 23 20:03:51 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:03:51 user nova-compute[74429]:     <system>
Oct 23 20:03:51 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:03:51 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:03:51 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:03:51 user nova-compute[74429]:       <entry name="serial">18e01426-64cf-4ca4-90b6-58e17f80242c</entry>
Oct 23 20:03:51 user nova-compute[74429]:       <entry name="uuid">18e01426-64cf-4ca4-90b6-58e17f80242c</entry>
Oct 23 20:03:51 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:03:51 user nova-compute[74429]:     </system>
Oct 23 20:03:51 user nova-compute[74429]:   </sysinfo>
Oct 23 20:03:51 user nova-compute[74429]:   <os>
Oct 23 20:03:51 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:03:51 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:03:51 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:03:51 user nova-compute[74429]:   </os>
Oct 23 20:03:51 user nova-compute[74429]:   <features>
Oct 23 20:03:51 user nova-compute[74429]:     <acpi/>
Oct 23 20:03:51 user nova-compute[74429]:     <apic/>
Oct 23 20:03:51 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:03:51 user nova-compute[74429]:   </features>
Oct 23 20:03:51 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:03:51 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:03:51 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:03:51 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:03:51 user nova-compute[74429]:   </clock>
Oct 23 20:03:51 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:03:51 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:03:51 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:03:51 user nova-compute[74429]:   </cpu>
Oct 23 20:03:51 user nova-compute[74429]:   <devices>
Oct 23 20:03:51 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:03:51 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:51 user nova-compute[74429]:       <source dev="/dev/sdh"/>
Oct 23 20:03:51 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:03:51 user nova-compute[74429]:       <serial>e05e591c-4315-4349-8f87-450ba1215d64</serial>
Oct 23 20:03:51 user nova-compute[74429]:     </disk>
Oct 23 20:03:51 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:03:51 user nova-compute[74429]:       <mac address="fa:16:3e:1b:15:d1"/>
Oct 23 20:03:51 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:03:51 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:03:51 user nova-compute[74429]:       <target dev="tap8b8176bc-f9"/>
Oct 23 20:03:51 user nova-compute[74429]:     </interface>
Oct 23 20:03:51 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:03:51 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c/console.log" append="off"/>
Oct 23 20:03:51 user nova-compute[74429]:     </serial>
Oct 23 20:03:51 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:03:51 user nova-compute[74429]:     <video>
Oct 23 20:03:51 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:03:51 user nova-compute[74429]:     </video>
Oct 23 20:03:51 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:03:51 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:03:51 user nova-compute[74429]:     </rng>
Oct 23 20:03:51 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:03:51 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:03:51 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:03:51 user nova-compute[74429]:     </memballoon>
Oct 23 20:03:51 user nova-compute[74429]:   </devices>
Oct 23 20:03:51 user nova-compute[74429]: </domain>
Oct 23 20:03:51 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-234378906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-21309619',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYaIxZ7haGHQMD2Sc8iBoGdZU3kvelcOBgu+qFikPLl+VRRGeDnKWY3kG8gozWbDIfd0wVL3Fo7n6yEXtY6YFq0e1EKglNJL7sWOSRs01CeH9d99XcJG2Pv5Mb2uI6tQ==',key_name='tempest-keypair-40106845',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b589e45483454d7a90358486b8226198',ramdisk_id='',reservation_id='r-c80lshri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1521560130',owner_user_name='tempest-ServerActionsV293TestJSON-1521560130-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4f293bc56648d1a664c7487f868607',uuid=18e01426-64cf-4ca4-90b6-58e17f80242c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converting VIF {"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[af577b79-e4d8-4385-8c5c-9302971fa262]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658] added
Oct 23 20:03:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04d863a5-e9fe-5563-bcde-756c544b3fe5', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[097967f5-0ab8-452e-bab1-2cb237234f65]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8176bc-f9, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b8176bc-f9, col_values=(('qos', UUID('22a05cc9-6a24-4e9e-8b00-67fb7676f02e')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b8176bc-f9, col_values=(('external_ids', {'iface-id': '8b8176bc-f9da-4a7a-a3c1-14a69c90959c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:15:d1', 'vm-uuid': '18e01426-64cf-4ca4-90b6-58e17f80242c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf330ea-5ae1-4538-b583-e257707ecb14]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzLDEqie {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: INFO os_vif [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9')
Oct 23 20:03:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance destroyed successfully.
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzLDEqie" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece9b50-1d0d-4f03-b70f-d11a56cc2b41]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HzLDEqie'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Attempting a stable device rescue
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf52d9-b3ff-48b0-8767-57897ac401d0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2f2aaa-f551-4796-9701-b797a87fd6d2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:51 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74429) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] No VIF found with MAC fa:16:3e:1b:15:d1, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:03:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Creating image(s)
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "1a7194e8474272edd9aa7849d20d69b439ad7113" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "1a7194e8474272edd9aa7849d20d69b439ad7113" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --login" returned: 0 in 0.142s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dcb99a-2c1c-460c-a9b3-5e42ba8a06bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260]
Oct 23 20:03:51 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.135s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ffa2c-9431-460a-8bc3-7158e71453fa]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa2a7be-687e-4b5f-b09b-7ddff65e52f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:53 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:53 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.750s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:53 user nova-compute[74429]: INFO nova.compute.manager [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Terminating instance
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[47199448-a7f2-4049-953a-a27d0f4f60df]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.part --force-share --output=json" returned: 0 in 0.276s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.virt.images [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] 4c736392-4dd8-44b6-98b0-cb2bd660c49d was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.part /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-14fc05bb-efce-494b-8e70-415b3c675247 req-efaaf59f-c7c4-47b3-8b9a-3304670da3a3 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-14fc05bb-efce-494b-8e70-415b3c675247 req-efaaf59f-c7c4-47b3-8b9a-3304670da3a3 service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-14fc05bb-efce-494b-8e70-415b3c675247 req-efaaf59f-c7c4-47b3-8b9a-3304670da3a3 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-14fc05bb-efce-494b-8e70-415b3c675247 req-efaaf59f-c7c4-47b3-8b9a-3304670da3a3 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-14fc05bb-efce-494b-8e70-415b3c675247 req-efaaf59f-c7c4-47b3-8b9a-3304670da3a3 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:53 user nova-compute[74429]: WARNING nova.compute.manager [req-14fc05bb-efce-494b-8e70-415b3c675247 req-efaaf59f-c7c4-47b3-8b9a-3304670da3a3 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state rescuing.
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-4a8b7ca7-a1f6-46e7-bb64-b37573176382 req-1a420f94-b83f-41bc-9171-2aae30f617e5 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4a8b7ca7-a1f6-46e7-bb64-b37573176382 req-1a420f94-b83f-41bc-9171-2aae30f617e5 service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4a8b7ca7-a1f6-46e7-bb64-b37573176382 req-1a420f94-b83f-41bc-9171-2aae30f617e5 service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4a8b7ca7-a1f6-46e7-bb64-b37573176382 req-1a420f94-b83f-41bc-9171-2aae30f617e5 service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-4a8b7ca7-a1f6-46e7-bb64-b37573176382 req-1a420f94-b83f-41bc-9171-2aae30f617e5 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:53 user nova-compute[74429]: WARNING nova.compute.manager [req-4a8b7ca7-a1f6-46e7-bb64-b37573176382 req-1a420f94-b83f-41bc-9171-2aae30f617e5 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state active and task_state rebuild_spawning.
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.part /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.converted" returned: 0 in 0.590s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-87ed7121-1fb7-4217-bafd-87fc22de7261 req-5f9a7796-81a4-41f5-a652-32f62ce241ec service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87ed7121-1fb7-4217-bafd-87fc22de7261 req-5f9a7796-81a4-41f5-a652-32f62ce241ec service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87ed7121-1fb7-4217-bafd-87fc22de7261 req-5f9a7796-81a4-41f5-a652-32f62ce241ec service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87ed7121-1fb7-4217-bafd-87fc22de7261 req-5f9a7796-81a4-41f5-a652-32f62ce241ec service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-87ed7121-1fb7-4217-bafd-87fc22de7261 req-5f9a7796-81a4-41f5-a652-32f62ce241ec service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-87ed7121-1fb7-4217-bafd-87fc22de7261 req-5f9a7796-81a4-41f5-a652-32f62ce241ec service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-ec078dd6-2e2c-4756-b098-7440ac870016 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113.converted --force-share --output=json" returned: 0 in 0.265s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "1a7194e8474272edd9aa7849d20d69b439ad7113" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.449s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "1a7194e8474272edd9aa7849d20d69b439ad7113" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "1a7194e8474272edd9aa7849d20d69b439ad7113" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.851s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] <== connect_volume: return (5690ms) {'type': 'block', 'scsi_wwn': '26462363833323936', 'path': '/dev/sdi'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462363833323936', 'path': '/dev/sdi'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843622581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843622581',id=11,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-n3ca9kmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:02:20Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=9901998c-ee34-4de9-b819-bc6c23bdfcdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'pci_devices' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:54 user nova-compute[74429]: INFO nova.compute.manager [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Detaching volume 69718eb6-5d31-4c12-a393-59513be2757a
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:03:54 user nova-compute[74429]:   <uuid>9901998c-ee34-4de9-b819-bc6c23bdfcdd</uuid>
Oct 23 20:03:54 user nova-compute[74429]:   <name>instance-0000000b</name>
Oct 23 20:03:54 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:03:54 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:03:54 user nova-compute[74429]:   <metadata>
Oct 23 20:03:54 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:03:54 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:03:54 user nova-compute[74429]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1843622581</nova:name>
Oct 23 20:03:54 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:03:48</nova:creationTime>
Oct 23 20:03:54 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:03:54 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:03:54 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:03:54 user nova-compute[74429]:       <nova:owner>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:user uuid="734b0b0d04104bfeab582780b77764cf">tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member</nova:user>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:project uuid="201753405b7c4553af3b39f82311a3d2">tempest-ServerBootFromVolumeStableRescueTest-1279644555</nova:project>
Oct 23 20:03:54 user nova-compute[74429]:       </nova:owner>
Oct 23 20:03:54 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:03:54 user nova-compute[74429]:       <nova:ports>
Oct 23 20:03:54 user nova-compute[74429]:         <nova:port uuid="de2fe581-050a-4bab-aec1-15928e24366b">
Oct 23 20:03:54 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:03:54 user nova-compute[74429]:         </nova:port>
Oct 23 20:03:54 user nova-compute[74429]:       </nova:ports>
Oct 23 20:03:54 user nova-compute[74429]:     </nova:instance>
Oct 23 20:03:54 user nova-compute[74429]:   </metadata>
Oct 23 20:03:54 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:03:54 user nova-compute[74429]:     <system>
Oct 23 20:03:54 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:03:54 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:03:54 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:03:54 user nova-compute[74429]:       <entry name="serial">9901998c-ee34-4de9-b819-bc6c23bdfcdd</entry>
Oct 23 20:03:54 user nova-compute[74429]:       <entry name="uuid">9901998c-ee34-4de9-b819-bc6c23bdfcdd</entry>
Oct 23 20:03:54 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:03:54 user nova-compute[74429]:     </system>
Oct 23 20:03:54 user nova-compute[74429]:   </sysinfo>
Oct 23 20:03:54 user nova-compute[74429]:   <os>
Oct 23 20:03:54 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:03:54 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:03:54 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:03:54 user nova-compute[74429]:   </os>
Oct 23 20:03:54 user nova-compute[74429]:   <features>
Oct 23 20:03:54 user nova-compute[74429]:     <acpi/>
Oct 23 20:03:54 user nova-compute[74429]:     <apic/>
Oct 23 20:03:54 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:03:54 user nova-compute[74429]:   </features>
Oct 23 20:03:54 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:03:54 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:03:54 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:03:54 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:03:54 user nova-compute[74429]:   </clock>
Oct 23 20:03:54 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:03:54 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:03:54 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:03:54 user nova-compute[74429]:   </cpu>
Oct 23 20:03:54 user nova-compute[74429]:   <devices>
Oct 23 20:03:54 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:03:54 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:54 user nova-compute[74429]:       <source dev="/dev/sdi"/>
Oct 23 20:03:54 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:03:54 user nova-compute[74429]:       <serial>ee7fb1f1-09e6-457f-8f31-1c3aff0a5658</serial>
Oct 23 20:03:54 user nova-compute[74429]:     </disk>
Oct 23 20:03:54 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:03:54 user nova-compute[74429]:       <mac address="fa:16:3e:e9:c8:13"/>
Oct 23 20:03:54 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:03:54 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:03:54 user nova-compute[74429]:       <target dev="tapde2fe581-05"/>
Oct 23 20:03:54 user nova-compute[74429]:     </interface>
Oct 23 20:03:54 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:03:54 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/console.log" append="off"/>
Oct 23 20:03:54 user nova-compute[74429]:     </serial>
Oct 23 20:03:54 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:03:54 user nova-compute[74429]:     <video>
Oct 23 20:03:54 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:03:54 user nova-compute[74429]:     </video>
Oct 23 20:03:54 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:03:54 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:03:54 user nova-compute[74429]:     </rng>
Oct 23 20:03:54 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:03:54 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:03:54 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:03:54 user nova-compute[74429]:     </memballoon>
Oct 23 20:03:54 user nova-compute[74429]:   </devices>
Oct 23 20:03:54 user nova-compute[74429]: </domain>
Oct 23 20:03:54 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843622581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843622581',id=11,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-n3ca9kmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:02:20Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=9901998c-ee34-4de9-b819-bc6c23bdfcdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_vif [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50020015-97bf-5d69-ad4c-6a6a118e0730', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113 --force-share --output=json" returned: 0 in 0.234s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113,backing_fmt=raw /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: INFO nova.virt.block_device [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Attempting to driver detach volume 69718eb6-5d31-4c12-a393-59513be2757a from mountpoint /dev/vdb
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113,backing_fmt=raw /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue" returned: 0 in 0.068s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "1a7194e8474272edd9aa7849d20d69b439ad7113" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'migration_context' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Object Instance<a6709080-2cd7-4ee9-9d6e-7390fc5ae21b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Start _get_guest_xml network_info=[{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "vif_mac": "fa:16:3e:00:37:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4c736392-4dd8-44b6-98b0-cb2bd660c49d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'e604dc92-1397-4ddf-b96a-df300998c27e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzESxjRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a6709080-2cd7-4ee9-9d6e-7390fc5ae21b', 'attached_at': '', 'detached_at': '', 'volume_id': '12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'serial': '12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'resources' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Object Instance<a6709080-2cd7-4ee9-9d6e-7390fc5ae21b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'numa_topology' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde2fe581-05, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde2fe581-05, col_values=(('qos', UUID('f2403f8d-3fee-4ae3-a4af-808335c6c890')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde2fe581-05, col_values=(('external_ids', {'iface-id': 'de2fe581-050a-4bab-aec1-15928e24366b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:c8:13', 'vm-uuid': '9901998c-ee34-4de9-b819-bc6c23bdfcdd'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Object Instance<a6709080-2cd7-4ee9-9d6e-7390fc5ae21b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Attempting to detach device vdb from instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:03:54 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:54 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:03:54 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:03:54 user nova-compute[74429]:   <serial>69718eb6-5d31-4c12-a393-59513be2757a</serial>
Oct 23 20:03:54 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:03:54 user nova-compute[74429]: </disk>
Oct 23 20:03:54 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:03:54 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:03:54 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:03:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully detached device vdb from instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 from the persistent domain config.
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:03:54 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:54 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:03:54 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:03:54 user nova-compute[74429]:   <serial>69718eb6-5d31-4c12-a393-59513be2757a</serial>
Oct 23 20:03:54 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:03:54 user nova-compute[74429]: </disk>
Oct 23 20:03:54 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Object Instance<a6709080-2cd7-4ee9-9d6e-7390fc5ae21b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzESxjRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:54 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:54 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:54 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: INFO os_vif [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05')
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcaba66-e050-40de-9399-34bcb96d68dd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mzESxjRI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 20:03:54 user nova-compute[74429]: node.name = iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:03:54 user nova-compute[74429]: node.tpgt = -1
Oct 23 20:03:54 user nova-compute[74429]: node.startup = automatic
Oct 23 20:03:54 user nova-compute[74429]: node.leading_login = No
Oct 23 20:03:54 user nova-compute[74429]: iface.iscsi_ifacename = default
Oct 23 20:03:54 user nova-compute[74429]: iface.net_ifacename = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.ipaddress = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.prefix_len = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.hwaddress = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.transport_name = tcp
Oct 23 20:03:54 user nova-compute[74429]: iface.initiatorname = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.vlan_id = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.vlan_priority = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.vlan_state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.iface_num = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.mtu = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.port = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.bootproto = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.subnet_mask = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.gateway = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_alt_client_id = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_dns = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_learn_iqn = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_vendor_id_state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_vendor_id = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.dhcp_slp_da = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.fragmentation = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.gratuitous_arp = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.incoming_forwarding = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.tos_state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.tos = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.ttl = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.delayed_ack = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.tcp_nagle = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.tcp_wsf_state = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.tcp_wsf = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.tcp_timer_scale = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.tcp_timestamp = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.redirect = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.def_task_mgmt_timeout = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.header_digest = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.data_digest = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.immediate_data = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.initial_r2t = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.data_seq_inorder = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.data_pdu_inorder = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.erl = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.max_receive_data_len = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.first_burst_len = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.max_outstanding_r2t = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.max_burst_len = 0
Oct 23 20:03:54 user nova-compute[74429]: iface.chap_auth = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.bidi_chap = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.strict_login_compliance = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.discovery_auth = <empty>
Oct 23 20:03:54 user nova-compute[74429]: iface.discovery_logout = <empty>
Oct 23 20:03:54 user nova-compute[74429]: node.discovery_address = <empty>
Oct 23 20:03:54 user nova-compute[74429]: node.discovery_port = 0
Oct 23 20:03:54 user nova-compute[74429]: node.discovery_type = static
Oct 23 20:03:54 user nova-compute[74429]: node.session.initial_cmdsn = 0
Oct 23 20:03:54 user nova-compute[74429]: node.session.initial_login_retry_max = 8
Oct 23 20:03:54 user nova-compute[74429]: node.session.xmit_thread_priority = -20
Oct 23 20:03:54 user nova-compute[74429]: node.session.cmds_max = 128
Oct 23 20:03:54 user nova-compute[74429]: node.session.queue_depth = 32
Oct 23 20:03:54 user nova-compute[74429]: node.session.nr_sessions = 1
Oct 23 20:03:54 user nova-compute[74429]: node.session.auth.authmethod = CHAP
Oct 23 20:03:54 user nova-compute[74429]: node.session.auth.username = mzESxjRI
Oct 23 20:03:54 user nova-compute[74429]: node.session.auth.password = ***
Oct 23 20:03:54 user nova-compute[74429]: node.session.auth.username_in = <empty>
Oct 23 20:03:54 user nova-compute[74429]: node.session.auth.password_in = <empty>
Oct 23 20:03:54 user nova-compute[74429]: node.session.auth.chap_algs = MD5
Oct 23 20:03:54 user nova-compute[74429]: node.session.timeo.replacement_timeout = 120
Oct 23 20:03:54 user nova-compute[74429]: node.session.err_timeo.abort_timeout = 15
Oct 23 20:03:54 user nova-compute[74429]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 20:03:54 user nova-compute[74429]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 20:03:54 user nova-compute[74429]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.FastAbort = Yes
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.InitialR2T = No
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.ImmediateData = Yes
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.MaxConnections = 1
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 20:03:54 user nova-compute[74429]: node.session.iscsi.ERL = 0
Oct 23 20:03:54 user nova-compute[74429]: node.session.scan = manual
Oct 23 20:03:54 user nova-compute[74429]: node.session.reopen_max = 0
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].address = 172.16.0.220
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].port = 3260
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].startup = manual
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].tcp.window_size = 524288
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].tcp.type_of_service = 0
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].timeo.logout_timeout = 15
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].timeo.login_timeout = 15
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].timeo.auth_timeout = 45
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].iscsi.DataDigest = None
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].iscsi.IFMarker = No
Oct 23 20:03:54 user nova-compute[74429]: node.conn[0].iscsi.OFMarker = No
Oct 23 20:03:54 user nova-compute[74429]: # END RECORD
Oct 23 20:03:54 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb563b0-f88b-49a5-9d65-38acfb62faf9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1412e-3976-4470-86af-c64537d0f0c0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzESxjRI {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mzESxjRI" returned: 0 in 0.033s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac03bc-f6a2-4259-81b3-516c970717e0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mzESxjRI'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No VIF found with MAC fa:16:3e:e9:c8:13, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb6ec5d-016c-4ce5-9992-8bfe8e6d597a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d211cc-29bf-48fe-bcbc-78e22b9cc224]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:54 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:54 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91e7222-30f1-4c4b-9449-9a949092ffdf]: (4, ('0 0 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzESxjRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.272s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] <== connect_volume: return (273ms) {'type': 'block', 'scsi_wwn': '26363656236363136', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363656236363136', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1699081527',display_name='tempest-ServerStableDeviceRescueTest-server-1699081527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1699081527',id=4,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2Jg3pnZIV6KdiWvNFbrI5BCvfS0w00IzRsIvTJ4VWI8DWNqRo5u9/MJx5Tsxja1iY+qnFhS+w3Qdtu3A4TDZnJ8qQfBHriSrG4xi723no/XkjimGWh+8PWeK/2SgP3Ww==',key_name='tempest-keypair-874344455',keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3f0451253f94380b18335a46be24fa1',ramdisk_id='',reservation_id='r-qbloz6l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1612166300',owner_user_name='tempest-ServerStableDeviceRescueTest-1612166300-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88700b7acce44892b2cb4fe00e1a25df',uuid=a6709080-2cd7-4ee9-9d6e-7390fc5ae21b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "vif_mac": "fa:16:3e:00:37:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converting VIF {"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "vif_mac": "fa:16:3e:00:37:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'pci_devices' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Object Instance<a6709080-2cd7-4ee9-9d6e-7390fc5ae21b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:03:55 user nova-compute[74429]:   <uuid>a6709080-2cd7-4ee9-9d6e-7390fc5ae21b</uuid>
Oct 23 20:03:55 user nova-compute[74429]:   <name>instance-00000004</name>
Oct 23 20:03:55 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:03:55 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:03:55 user nova-compute[74429]:   <metadata>
Oct 23 20:03:55 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:03:55 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:03:55 user nova-compute[74429]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1699081527</nova:name>
Oct 23 20:03:55 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:03:54</nova:creationTime>
Oct 23 20:03:55 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:03:55 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:03:55 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:03:55 user nova-compute[74429]:       <nova:owner>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:user uuid="88700b7acce44892b2cb4fe00e1a25df">tempest-ServerStableDeviceRescueTest-1612166300-project-member</nova:user>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:project uuid="a3f0451253f94380b18335a46be24fa1">tempest-ServerStableDeviceRescueTest-1612166300</nova:project>
Oct 23 20:03:55 user nova-compute[74429]:       </nova:owner>
Oct 23 20:03:55 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:03:55 user nova-compute[74429]:       <nova:ports>
Oct 23 20:03:55 user nova-compute[74429]:         <nova:port uuid="2d3359d2-106a-4f09-a6e7-d5cafc924c2b">
Oct 23 20:03:55 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 20:03:55 user nova-compute[74429]:         </nova:port>
Oct 23 20:03:55 user nova-compute[74429]:       </nova:ports>
Oct 23 20:03:55 user nova-compute[74429]:     </nova:instance>
Oct 23 20:03:55 user nova-compute[74429]:   </metadata>
Oct 23 20:03:55 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:03:55 user nova-compute[74429]:     <system>
Oct 23 20:03:55 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:03:55 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:03:55 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:03:55 user nova-compute[74429]:       <entry name="serial">a6709080-2cd7-4ee9-9d6e-7390fc5ae21b</entry>
Oct 23 20:03:55 user nova-compute[74429]:       <entry name="uuid">a6709080-2cd7-4ee9-9d6e-7390fc5ae21b</entry>
Oct 23 20:03:55 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:03:55 user nova-compute[74429]:     </system>
Oct 23 20:03:55 user nova-compute[74429]:   </sysinfo>
Oct 23 20:03:55 user nova-compute[74429]:   <os>
Oct 23 20:03:55 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:03:55 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:03:55 user nova-compute[74429]:   </os>
Oct 23 20:03:55 user nova-compute[74429]:   <features>
Oct 23 20:03:55 user nova-compute[74429]:     <acpi/>
Oct 23 20:03:55 user nova-compute[74429]:     <apic/>
Oct 23 20:03:55 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:03:55 user nova-compute[74429]:   </features>
Oct 23 20:03:55 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:03:55 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:03:55 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:03:55 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:03:55 user nova-compute[74429]:   </clock>
Oct 23 20:03:55 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:03:55 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:03:55 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:03:55 user nova-compute[74429]:   </cpu>
Oct 23 20:03:55 user nova-compute[74429]:   <devices>
Oct 23 20:03:55 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:03:55 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:03:55 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk"/>
Oct 23 20:03:55 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:03:55 user nova-compute[74429]:     </disk>
Oct 23 20:03:55 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:03:55 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:03:55 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:03:55 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:03:55 user nova-compute[74429]:       <serial>12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd</serial>
Oct 23 20:03:55 user nova-compute[74429]:     </disk>
Oct 23 20:03:55 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:03:55 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:03:55 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue"/>
Oct 23 20:03:55 user nova-compute[74429]:       <target dev="vdc" bus="virtio"/>
Oct 23 20:03:55 user nova-compute[74429]:       <boot order="1"/>
Oct 23 20:03:55 user nova-compute[74429]:     </disk>
Oct 23 20:03:55 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:03:55 user nova-compute[74429]:       <mac address="fa:16:3e:00:37:0d"/>
Oct 23 20:03:55 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:03:55 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:03:55 user nova-compute[74429]:       <target dev="tap2d3359d2-10"/>
Oct 23 20:03:55 user nova-compute[74429]:     </interface>
Oct 23 20:03:55 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:03:55 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/console.log" append="off"/>
Oct 23 20:03:55 user nova-compute[74429]:     </serial>
Oct 23 20:03:55 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:03:55 user nova-compute[74429]:     <video>
Oct 23 20:03:55 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:03:55 user nova-compute[74429]:     </video>
Oct 23 20:03:55 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:03:55 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:03:55 user nova-compute[74429]:     </rng>
Oct 23 20:03:55 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:03:55 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:03:55 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:03:55 user nova-compute[74429]:     </memballoon>
Oct 23 20:03:55 user nova-compute[74429]:   </devices>
Oct 23 20:03:55 user nova-compute[74429]: </domain>
Oct 23 20:03:55 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:03:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance destroyed successfully.
Oct 23 20:03:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] No VIF found with MAC fa:16:3e:00:37:0d, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:55 user nova-compute[74429]: WARNING nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-0dc7dfb3-0a86-4bc9-9946-1d47284331ee for instance with vm_state active and task_state deleting.
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-61a1c96b-1926-4230-8e9f-742d284f67ad req-869d8d1c-1dbf-451d-a4de-6bdde8cd3d83 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-62a87f4c-7859-48e7-b8b6-12f4c716195d for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:55 user nova-compute[74429]: WARNING nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state active and task_state rebuild_spawning.
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-5fd49d73-8202-45c2-bce0-af9878f2f69d for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:55 user nova-compute[74429]: WARNING nova.compute.manager [req-a7ef3c66-3263-4d7f-9121-5e0bcfda8e14 req-3c96f12c-ebbe-4b18-ae30-7ac7a75cff88 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-5fd49d73-8202-45c2-bce0-af9878f2f69d for instance with vm_state active and task_state deleting.
Oct 23 20:03:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: WARNING nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-ec078dd6-2e2c-4756-b098-7440ac870016 for instance with vm_state active and task_state deleting.
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: WARNING nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-1075b40b-72dd-4cd0-9f92-4df660e297a2 for instance with vm_state active and task_state deleting.
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: WARNING nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 for instance with vm_state active and task_state deleting.
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-unplugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-unplugged-d962c332-6693-43a2-ba24-a4d39677f1d6 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:56 user nova-compute[74429]: WARNING nova.compute.manager [req-a0ccb43f-35c4-4822-a710-2dbdc451776a req-200681c2-e1e7-40ac-a421-3bf14450e2aa service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-d962c332-6693-43a2-ba24-a4d39677f1d6 for instance with vm_state active and task_state deleting.
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:03:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance spawned successfully.
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74429) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 20:03:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Instance destroyed successfully.
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lazy-loading 'resources' on Instance uuid d35828f9-195d-4ece-a2d9-db474bc6b581 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-79258094-ca95-4a88-a8f2-c24ebf3fa439 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.239s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fd49d73-82, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bdb560b-78df-4f27-8d2a-f9c8c6562b1d) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:9e:18,bridge_name='br-int',has_traffic_filtering=True,id=5fd49d73-8202-45c2-bce0-af9878f2f69d,network=Network(6275e3fa-838f-42b1-9db7-764f4c803ee4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd49d73-82')
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec078dd6-2e, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e673f2e1-0bb5-439d-bff6-3fcd447aa91c) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ec078dd6-2e2c-4756-b098-7440ac870016,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec078dd6-2e')
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dc7dfb3-0a, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b6dea41-4586-4b56-ad4c-bb3e684b4c87) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:15:2a,bridge_name='br-int',has_traffic_filtering=True,id=0dc7dfb3-0a86-4bc9-9946-1d47284331ee,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dc7dfb3-0a')
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b53f44b-d9, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98973e99-0fef-4111-bc68-183cc589bdfc) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a05b33a-4eda-45c2-b7e5-63d81bf4386d req-99b85c7f-5a0d-403b-abc6-b3b5c94dbf0b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a05b33a-4eda-45c2-b7e5-63d81bf4386d req-99b85c7f-5a0d-403b-abc6-b3b5c94dbf0b service nova] Acquiring lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a05b33a-4eda-45c2-b7e5-63d81bf4386d req-99b85c7f-5a0d-403b-abc6-b3b5c94dbf0b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a05b33a-4eda-45c2-b7e5-63d81bf4386d req-99b85c7f-5a0d-403b-abc6-b3b5c94dbf0b service nova] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a05b33a-4eda-45c2-b7e5-63d81bf4386d req-99b85c7f-5a0d-403b-abc6-b3b5c94dbf0b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] No waiting events found dispatching network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:57 user nova-compute[74429]: WARNING nova.compute.manager [req-2a05b33a-4eda-45c2-b7e5-63d81bf4386d req-99b85c7f-5a0d-403b-abc6-b3b5c94dbf0b service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received unexpected event network-vif-plugged-62a87f4c-7859-48e7-b8b6-12f4c716195d for instance with vm_state active and task_state deleting.
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b53f44b-d9')
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1075b40b-72, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc4163b6-7ebc-405a-9527-ce5c55fcd213) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4e:e7,bridge_name='br-int',has_traffic_filtering=True,id=1075b40b-72dd-4cd0-9f92-4df660e297a2,network=Network(9c19bf17-728d-4bb5-95c9-f342640d5455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1075b40b-72')
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd962c332-66, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8980212-5ea0-4655-99c9-66c737504ce0) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:92:38,bridge_name='br-int',has_traffic_filtering=True,id=d962c332-6693-43a2-ba24-a4d39677f1d6,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd962c332-66')
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1249677625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1249677625',id=10,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+b8r74QMDnHdqUlPOrlYCaRxJFvHY7qMu6C+LRbBMGpeyhx88YHXPWwpxB9QR8Du11VNTtwU4oklcWLN4y0dUcUZaFISL7rzWT5W+EZg0TvTuiRKT++Dw5PAbNfahppg==',key_name='tempest-keypair-1347656914',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c56f49c4c14d4184db943b8f63fb8d',ramdisk_id='',reservation_id='r-3fx285bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-588228488',owner_user_name='tempest-TaggedBootDevicesTest_v242-588228488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f8025204f0a43fcace00948d9ac54a4',uuid=d35828f9-195d-4ece-a2d9-db474bc6b581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converting VIF {"id": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "address": "fa:16:3e:78:a4:db", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a87f4c-78", "ovs_interfaceid": "62a87f4c-7859-48e7-b8b6-12f4c716195d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62a87f4c-78, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72277c4b-5022-48a5-b040-bf9b7fe6b994) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: INFO os_vif [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:a4:db,bridge_name='br-int',has_traffic_filtering=True,id=62a87f4c-7859-48e7-b8b6-12f4c716195d,network=Network(141e2252-1c6d-46e8-8e21-345b417334f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a87f4c-78')
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqeNZsyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:58 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682af41-f534-40b7-a1a1-fd9756bf58bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:03:58 user nova-compute[74429]: No targets found.
Oct 23 20:03:58 user nova-compute[74429]: iSNS:
Oct 23 20:03:58 user nova-compute[74429]: No targets found.
Oct 23 20:03:58 user nova-compute[74429]: STATIC:
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: FIRMWARE:
Oct 23 20:03:58 user nova-compute[74429]: No targets found.
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:03:58 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:03:58 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f48d8fa-42b4-47be-87f8-c0df0bee5368]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bca0f09-8f11-4c4d-a811-d71d16b15180]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580b2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1'): ({'sde'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Removing single pathed devices sde {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b408551-0194-42d8-a6a7-1d8cc7b37a6b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[01373ef6-2ae8-4c73-8608-b62da68d8650]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Flushing IO for device /dev/sde {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[703926f3-378c-45fc-bbdf-acfa04ff368f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[99222ac2-1264-4688-a6ae-85b3ac34b6c5]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[70299e3e-11fe-4c52-a695-8c83f31bed21]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c24059e-db8e-4e4d-8635-8fab1dee0c16]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260]
Oct 23 20:03:58 user nova-compute[74429]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce004c2-97c2-4424-bfaa-db850ba63ef1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[203fddd7-1b8b-44d3-9d44-b22d27899eb5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== disconnect_volume: return (473ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrItNjLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:58 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ec0a95-90e9-436a-a0f4-042d382d6f4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:03:58 user nova-compute[74429]: No targets found.
Oct 23 20:03:58 user nova-compute[74429]: iSNS:
Oct 23 20:03:58 user nova-compute[74429]: No targets found.
Oct 23 20:03:58 user nova-compute[74429]: STATIC:
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:03:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:58 user nova-compute[74429]: FIRMWARE:
Oct 23 20:03:58 user nova-compute[74429]: No targets found.
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:03:58 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:03:58 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b29610e-67a5-4d01-a51a-64a10015620b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b030d-31ab-4d00-9bb7-682e541fe60e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c (non-flash)
Oct 23 20:03:58 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580b2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c'): ({'sdf'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Removing single pathed devices sdf {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[632fd99b-2da7-441e-837f-69c9dfc072bf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ca5099-58bb-470e-a41f-690d48056409]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Flushing IO for device /dev/sdf {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4809fdaf-ad9a-44c1-ae7f-0e8b89338ca5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaae3d7-f893-4332-8153-77997f9d8911]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] SCSI volumes sdf have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd702279-ac8d-4695-8337-15bcc74196f8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[887df3d4-369e-481e-a535-d0bda97e827b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260]
Oct 23 20:03:59 user nova-compute[74429]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da174691-ba88-4aef-a213-4b35f37a3d2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a28439-1a27-4ec0-b71a-024a45dc9921]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== disconnect_volume: return (448ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcxSyDmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:03:59 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[db262f71-8b5b-4850-b9f5-d5165d9bd756]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:03:59 user nova-compute[74429]: No targets found.
Oct 23 20:03:59 user nova-compute[74429]: iSNS:
Oct 23 20:03:59 user nova-compute[74429]: No targets found.
Oct 23 20:03:59 user nova-compute[74429]: STATIC:
Oct 23 20:03:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:03:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a
Oct 23 20:03:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:03:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:03:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:03:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749
Oct 23 20:03:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:03:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:03:59 user nova-compute[74429]: FIRMWARE:
Oct 23 20:03:59 user nova-compute[74429]: No targets found.
Oct 23 20:03:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:03:59 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:03:59 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f67ac-d220-4db2-ac23-c11a4ebb42f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97fdd6d-14b0-41b2-8015-38fdd3b8a061]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:03:59 user nova-compute[74429]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 (non-flash)
Oct 23 20:03:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580b2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749'): ({'sdg'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Removing single pathed devices sdg {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4f235-55b6-46d0-9831-d8d6c09807f7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09d630c-54f7-4811-bb1f-1f9b6a61eaae]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Flushing IO for device /dev/sdg {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85e13b-c30d-4dde-bc47-50eafe54c980]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[07861b70-2831-4327-9c5b-b7115b86bf55]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] SCSI volumes sdg have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84d02f0-25fd-470e-b349-b786e264c129]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[715eefb7-f3d7-49d8-81e7-5ef4804cb845]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260]
Oct 23 20:03:59 user nova-compute[74429]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749, portal: 172.16.0.220,3260] successful.
Oct 23 20:03:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:120fa027-74b8-488c-93b1-3c3860bdd749 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[802fad24-b406-422c-a665-7c2fc78fb940]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] <== disconnect_volume: return (482ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:03:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Deleting instance files /opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581_del
Oct 23 20:03:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Deletion of /opt/stack/data/nova/instances/d35828f9-195d-4ece-a2d9-db474bc6b581_del complete
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:59 user nova-compute[74429]: WARNING nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state building and task_state spawning.
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:59 user nova-compute[74429]: WARNING nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state building and task_state spawning.
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:03:59 user nova-compute[74429]: WARNING nova.compute.manager [req-6d1fd317-a5fe-4b00-8519-20b66b620115 req-0722b2cb-41ba-4734-9657-2c186c51269d service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state rescuing.
Oct 23 20:03:59 user nova-compute[74429]: INFO nova.compute.manager [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Took 6.43 seconds to destroy the instance on the hypervisor.
Oct 23 20:03:59 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:03:59 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:04:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:04:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance spawned successfully.
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:01 user nova-compute[74429]: INFO nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Took 13.13 seconds to spawn the instance on the hypervisor.
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-c68742bc-0a15-4161-b243-5cc7582a42fe req-59f5e408-0c32-4549-85ba-8213d5efbf2d service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c68742bc-0a15-4161-b243-5cc7582a42fe req-59f5e408-0c32-4549-85ba-8213d5efbf2d service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c68742bc-0a15-4161-b243-5cc7582a42fe req-59f5e408-0c32-4549-85ba-8213d5efbf2d service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c68742bc-0a15-4161-b243-5cc7582a42fe req-59f5e408-0c32-4549-85ba-8213d5efbf2d service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-c68742bc-0a15-4161-b243-5cc7582a42fe req-59f5e408-0c32-4549-85ba-8213d5efbf2d service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:04:01 user nova-compute[74429]: WARNING nova.compute.manager [req-c68742bc-0a15-4161-b243-5cc7582a42fe req-59f5e408-0c32-4549-85ba-8213d5efbf2d service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state rescuing.
Oct 23 20:04:01 user nova-compute[74429]: INFO nova.compute.manager [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Took 103.69 seconds to build instance.
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-fed4ff71-4bc3-4026-a138-007de3923f90 req-67777a90-b822-44a7-8907-75de46f0229a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-deleted-62a87f4c-7859-48e7-b8b6-12f4c716195d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:01 user nova-compute[74429]: INFO nova.compute.manager [req-fed4ff71-4bc3-4026-a138-007de3923f90 req-67777a90-b822-44a7-8907-75de46f0229a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Neutron deleted interface 62a87f4c-7859-48e7-b8b6-12f4c716195d; detaching it from the instance and deleting it from the info cache
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-fed4ff71-4bc3-4026-a138-007de3923f90 req-67777a90-b822-44a7-8907-75de46f0229a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [{"id": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "address": "fa:16:3e:5b:9e:18", "network": {"id": "6275e3fa-838f-42b1-9db7-764f4c803ee4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1876258933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd49d73-82", "ovs_interfaceid": "5fd49d73-8202-45c2-bce0-af9878f2f69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec078dd6-2e2c-4756-b098-7440ac870016", "address": "fa:16:3e:6f:3e:5d", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec078dd6-2e", "ovs_interfaceid": "ec078dd6-2e2c-4756-b098-7440ac870016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "address": "fa:16:3e:6a:15:2a", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc7dfb3-0a", "ovs_interfaceid": "0dc7dfb3-0a86-4bc9-9946-1d47284331ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "address": "fa:16:3e:7c:e0:98", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b53f44b-d9", "ovs_interfaceid": "0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "address": "fa:16:3e:0c:4e:e7", "network": {"id": "9c19bf17-728d-4bb5-95c9-f342640d5455", "bridge": "br-int", "label": "tempest-device-tagging-net1-1592306600", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1075b40b-72", "ovs_interfaceid": "1075b40b-72dd-4cd0-9f92-4df660e297a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d962c332-6693-43a2-ba24-a4d39677f1d6", "address": "fa:16:3e:88:92:38", "network": {"id": "141e2252-1c6d-46e8-8e21-345b417334f4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309601286", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "52c56f49c4c14d4184db943b8f63fb8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd962c332-66", "ovs_interfaceid": "d962c332-6693-43a2-ba24-a4d39677f1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5dcaa05d-015c-49f4-8de5-25cbdb93f39c tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 103.857s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-fed4ff71-4bc3-4026-a138-007de3923f90 req-67777a90-b822-44a7-8907-75de46f0229a service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Detach interface failed, port_id=62a87f4c-7859-48e7-b8b6-12f4c716195d, reason: Instance d35828f9-195d-4ece-a2d9-db474bc6b581 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:04:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d8260024-d7f6-4fcf-bdf7-ea630a221091 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:04:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:03 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:03 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Took 4.13 seconds to deallocate network for instance.
Oct 23 20:04:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-2fefb07e-3233-4678-a13e-58b0781e8f5f req-9b2d5d00-6574-499c-abb3-3e314753ac09 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-deleted-5fd49d73-8202-45c2-bce0-af9878f2f69d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-2fefb07e-3233-4678-a13e-58b0781e8f5f req-9b2d5d00-6574-499c-abb3-3e314753ac09 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-deleted-0b53f44b-d9c8-4b94-9e14-7a69e1bf9a33 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-2fefb07e-3233-4678-a13e-58b0781e8f5f req-9b2d5d00-6574-499c-abb3-3e314753ac09 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-deleted-1075b40b-72dd-4cd0-9f92-4df660e297a2 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-2fefb07e-3233-4678-a13e-58b0781e8f5f req-9b2d5d00-6574-499c-abb3-3e314753ac09 service nova] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Received event network-vif-deleted-d962c332-6693-43a2-ba24-a4d39677f1d6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:07 user nova-compute[74429]: INFO nova.compute.manager [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] [instance: d35828f9-195d-4ece-a2d9-db474bc6b581] Took 3.75 seconds to detach 3 volumes for instance.
Oct 23 20:04:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:08 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:04:08 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:04:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:08 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Deleted allocations for instance d35828f9-195d-4ece-a2d9-db474bc6b581
Oct 23 20:04:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84bf172-5014-4f23-aef8-d21b9abfc869 tempest-TaggedBootDevicesTest_v242-588228488 tempest-TaggedBootDevicesTest_v242-588228488-project-member] Lock "d35828f9-195d-4ece-a2d9-db474bc6b581" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.162s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:04:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:04:15 user nova-compute[74429]: INFO nova.compute.claims [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Claim successful on node user
Oct 23 20:04:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:15 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 is timed out.
Oct 23 20:04:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully detached device vdb from instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 from the live domain config.
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pORQfzNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:15 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[245d7000-a39b-4a35-ab77-cf73988d01ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:04:16 user nova-compute[74429]: No targets found.
Oct 23 20:04:16 user nova-compute[74429]: iSNS:
Oct 23 20:04:16 user nova-compute[74429]: No targets found.
Oct 23 20:04:16 user nova-compute[74429]: STATIC:
Oct 23 20:04:16 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:04:16 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:16 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:16 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a
Oct 23 20:04:16 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:16 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:16 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:04:16 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:16 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:16 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:04:16 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:16 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:16 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:04:16 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:16 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:16 user nova-compute[74429]: FIRMWARE:
Oct 23 20:04:16 user nova-compute[74429]: No targets found.
Oct 23 20:04:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:04:16 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:04:16 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[683eda60-d947-4c73-b89c-bf242acd7cdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bcc07b-a4af-4ae4-a25d-5666e78b5632]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:16 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d59352170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7483c8b-6063-4228-9ca4-77fd7aaf9f17]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[201a6229-0145-43a3-b484-e1bbccf6ee0a]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8409ea9-684f-4286-9989-39a3c4699e55]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d067b07-43e6-4373-b705-286e2fa6245d]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f869f04-81f4-461f-a5fb-2a7e5ea9e1a5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647d3a2-f283-4d62-8564-7e8fbbcd4320]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260]
Oct 23 20:04:16 user nova-compute[74429]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a, portal: 172.16.0.220,3260] successful.
Oct 23 20:04:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:04:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69718eb6-5d31-4c12-a393-59513be2757a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b2f39-3f4b-4a22-9b27-db7408c174c4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] <== disconnect_volume: return (442ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:04:16 user nova-compute[74429]: INFO nova.virt.block_device [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Booting with volume 09551b16-04fa-4c0c-bde5-232823622573 at /dev/vda
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.policy [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34d78625b5d04ef4a79e9cd60c6b31d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd293746ce9041b2a5a489f369e0d35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:04:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully created port: 76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:04:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7969MB free_disk=25.596534729003906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 18e01426-64cf-4ca4-90b6-58e17f80242c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully created port: 146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:04:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:19 user nova-compute[74429]: DEBUG nova.objects.instance [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'flavor' on Instance uuid 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:04:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ea6aebf-4d28-481f-bbfd-9de7d9b0fce1 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.307s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:19 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG os_brick.utils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully created port: 0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[208d7448-caf7-44ca-aeae-a7ffa3c13878]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8728d2c2-5a48-4f4d-b2ff-463e403032b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e845a9-224f-44fa-9005-3513ff80beba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3b0231-7a37-40d5-935e-feaa772c5e56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:04:20 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:04:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e98c257-5c6f-4a21-b024-ad4cca8d66d5]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG os_brick.utils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating existing volume attachment record: 7e59f9fa-deaa-4e00-a24a-ba6a3b68bd7e {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:04:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully created port: b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully created port: 6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:04:21 user nova-compute[74429]: INFO nova.compute.claims [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Claim successful on node user
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: 76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-76a266f2-c5cd-4169-ab6a-ad14e115b3b4. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:04:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.policy [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7124ed7c57024d3aa751c46d237ecf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345690fb675e48679dee09c586df74fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:04:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Creating image(s)
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "/opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "/opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "/opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb4ba2b-0a02-4842-a1aa-ada00025cb50 req-29298cd2-9202-442f-8e7a-ab91f5e024ed service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk 1073741824" returned: 0 in 0.054s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Successfully created port: 588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: 08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Cannot resize image /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Ensure instance console log exists: /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Successfully updated port: 588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquired lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-changed-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Refreshing instance network info cache due to event network-changed-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] Acquiring lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updating instance_info_cache with network_info: [{"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Releasing lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Instance network_info: |[{"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] Acquired lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Refreshing network info cache for port 588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Start _get_guest_xml network_info=[{"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:04:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:04:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: 81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1391600354',display_name='tempest-VolumesAdminNegativeTest-server-1391600354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1391600354',id=13,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl38gv9fGboKk+E8VXXB7JKDEXxADBOAIlknNe36vgGYvJBU+G/1jVqABn0aRINtebMjEisvqpiRd5jHQ8TRejkSEmlMgrPzG6FomRJdxl5xMxRcVI66viAnXK6nqz/dA==',key_name='tempest-keypair-1202165770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='345690fb675e48679dee09c586df74fe',ramdisk_id='',reservation_id='r-ys5vn7q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1432262633',owner_user_name='tempest-VolumesAdminNegativeTest-1432262633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7124ed7c57024d3aa751c46d237ecf50',uuid=b02494e7-5fd0-4a23-ae27-252fdea795c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converting VIF {"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'pci_devices' on Instance uuid b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:04:24 user nova-compute[74429]:   <uuid>b02494e7-5fd0-4a23-ae27-252fdea795c9</uuid>
Oct 23 20:04:24 user nova-compute[74429]:   <name>instance-0000000d</name>
Oct 23 20:04:24 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:04:24 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:04:24 user nova-compute[74429]:   <metadata>
Oct 23 20:04:24 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:04:24 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:04:24 user nova-compute[74429]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1391600354</nova:name>
Oct 23 20:04:24 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:04:24</nova:creationTime>
Oct 23 20:04:24 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:04:24 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:04:24 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:04:24 user nova-compute[74429]:       <nova:owner>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:user uuid="7124ed7c57024d3aa751c46d237ecf50">tempest-VolumesAdminNegativeTest-1432262633-project-member</nova:user>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:project uuid="345690fb675e48679dee09c586df74fe">tempest-VolumesAdminNegativeTest-1432262633</nova:project>
Oct 23 20:04:24 user nova-compute[74429]:       </nova:owner>
Oct 23 20:04:24 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:04:24 user nova-compute[74429]:       <nova:ports>
Oct 23 20:04:24 user nova-compute[74429]:         <nova:port uuid="588bcb4d-f13f-4c62-ab1f-e8e7b970f95f">
Oct 23 20:04:24 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 20:04:24 user nova-compute[74429]:         </nova:port>
Oct 23 20:04:24 user nova-compute[74429]:       </nova:ports>
Oct 23 20:04:24 user nova-compute[74429]:     </nova:instance>
Oct 23 20:04:24 user nova-compute[74429]:   </metadata>
Oct 23 20:04:24 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:04:24 user nova-compute[74429]:     <system>
Oct 23 20:04:24 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:04:24 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:04:24 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:04:24 user nova-compute[74429]:       <entry name="serial">b02494e7-5fd0-4a23-ae27-252fdea795c9</entry>
Oct 23 20:04:24 user nova-compute[74429]:       <entry name="uuid">b02494e7-5fd0-4a23-ae27-252fdea795c9</entry>
Oct 23 20:04:24 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:04:24 user nova-compute[74429]:     </system>
Oct 23 20:04:24 user nova-compute[74429]:   </sysinfo>
Oct 23 20:04:24 user nova-compute[74429]:   <os>
Oct 23 20:04:24 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:04:24 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:04:24 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:04:24 user nova-compute[74429]:   </os>
Oct 23 20:04:24 user nova-compute[74429]:   <features>
Oct 23 20:04:24 user nova-compute[74429]:     <acpi/>
Oct 23 20:04:24 user nova-compute[74429]:     <apic/>
Oct 23 20:04:24 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:04:24 user nova-compute[74429]:   </features>
Oct 23 20:04:24 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:04:24 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:04:24 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:04:24 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:04:24 user nova-compute[74429]:   </clock>
Oct 23 20:04:24 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:04:24 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:04:24 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:04:24 user nova-compute[74429]:   </cpu>
Oct 23 20:04:24 user nova-compute[74429]:   <devices>
Oct 23 20:04:24 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:04:24 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:04:24 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk"/>
Oct 23 20:04:24 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:04:24 user nova-compute[74429]:     </disk>
Oct 23 20:04:24 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:04:24 user nova-compute[74429]:       <mac address="fa:16:3e:c1:b2:41"/>
Oct 23 20:04:24 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:04:24 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:04:24 user nova-compute[74429]:       <target dev="tap588bcb4d-f1"/>
Oct 23 20:04:24 user nova-compute[74429]:     </interface>
Oct 23 20:04:24 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:04:24 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/console.log" append="off"/>
Oct 23 20:04:24 user nova-compute[74429]:     </serial>
Oct 23 20:04:24 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:04:24 user nova-compute[74429]:     <video>
Oct 23 20:04:24 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:04:24 user nova-compute[74429]:     </video>
Oct 23 20:04:24 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:04:24 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:04:24 user nova-compute[74429]:     </rng>
Oct 23 20:04:24 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:04:24 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:04:24 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:04:24 user nova-compute[74429]:     </memballoon>
Oct 23 20:04:24 user nova-compute[74429]:   </devices>
Oct 23 20:04:24 user nova-compute[74429]: </domain>
Oct 23 20:04:24 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1391600354',display_name='tempest-VolumesAdminNegativeTest-server-1391600354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1391600354',id=13,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl38gv9fGboKk+E8VXXB7JKDEXxADBOAIlknNe36vgGYvJBU+G/1jVqABn0aRINtebMjEisvqpiRd5jHQ8TRejkSEmlMgrPzG6FomRJdxl5xMxRcVI66viAnXK6nqz/dA==',key_name='tempest-keypair-1202165770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='345690fb675e48679dee09c586df74fe',ramdisk_id='',reservation_id='r-ys5vn7q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1432262633',owner_user_name='tempest-VolumesAdminNegativeTest-1432262633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7124ed7c57024d3aa751c46d237ecf50',uuid=b02494e7-5fd0-4a23-ae27-252fdea795c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converting VIF {"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG os_vif [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c10c346c-1ca3-57bf-b350-13ab38f74923', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap588bcb4d-f1, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap588bcb4d-f1, col_values=(('qos', UUID('8c447a3c-52f1-4c34-9a74-d73a3a5b170c')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap588bcb4d-f1, col_values=(('external_ids', {'iface-id': '588bcb4d-f13f-4c62-ab1f-e8e7b970f95f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:b2:41', 'vm-uuid': 'b02494e7-5fd0-4a23-ae27-252fdea795c9'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:24 user nova-compute[74429]: INFO os_vif [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1')
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No VIF found with MAC fa:16:3e:c1:b2:41, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-08e047dc-b906-4f12-8376-5143320b2875. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updated VIF entry in instance network info cache for port 588bcb4d-f13f-4c62-ab1f-e8e7b970f95f. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updating instance_info_cache with network_info: [{"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c88c045-8ce5-4ca0-9059-65f3d0c4be08 req-0c6ca278-ce29-4bd7-ba18-323876d9610b service nova] Releasing lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-81536a66-6e9d-4fba-82aa-652c7b34e8c5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7101dd35-ba02-43aa-9f6f-3b776e1085a3 req-f0b6f840-7a2d-4944-84bd-fc11a5334712 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: 146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: 0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-146d960d-25ab-46b0-b5ff-597a50999436. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] No waiting events found dispatching network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:04:26 user nova-compute[74429]: WARNING nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received unexpected event network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f for instance with vm_state building and task_state spawning.
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-0a880b39-b14a-486d-802b-315e5802de34. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:26 user nova-compute[74429]: DEBUG nova.network.neutron [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.network.neutron [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] No waiting events found dispatching network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:04:27 user nova-compute[74429]: WARNING nova.compute.manager [req-0a97d9df-18ef-4f7e-8e1a-9154e5eb1f5c req-0c6a5737-d594-4d7a-a9a3-78f249813111 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received unexpected event network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f for instance with vm_state building and task_state spawning.
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Successfully updated port: 6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:04:27 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Instance spawned successfully.
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:28 user nova-compute[74429]: INFO nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Took 5.57 seconds to spawn the instance on the hypervisor.
Oct 23 20:04:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:04:28 user nova-compute[74429]: INFO nova.compute.manager [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Took 6.33 seconds to build instance.
Oct 23 20:04:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-16eb6e36-dd77-4c1c-8d54-750c9e5cedf3 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.456s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-b482176d-b452-4813-ad77-1ee2dc570b5d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG nova.network.neutron [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance network_info: |[{"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updated VIF entry in instance network info cache for port b482176d-b452-4813-ad77-1ee2dc570b5d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-6481d5aa-66b4-4ab0-a0af-78c41dacef13. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updated VIF entry in instance network info cache for port 6481d5aa-66b4-4ab0-a0af-78c41dacef13. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-03b4e61b-3f20-467b-99a1-d3b2c33665c3 req-439c9621-b897-454f-82f3-3de94a0386d3 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:04:41 user nova-compute[74429]: INFO nova.compute.claims [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Claim successful on node user
Oct 23 20:04:41 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:41 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:04:42 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.policy [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80ac3c2700c2447993ba5a8e14db0aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8768b24d954f5cbb03c242e6a3a1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:04:42 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Creating image(s)
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "/opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "/opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk 1073741824" returned: 0 in 0.051s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Successfully created port: f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Cannot resize image /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Ensure instance console log exists: /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Successfully updated port: f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-changed-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Refreshing instance network info cache due to event network-changed-f2a7aa16-4b78-440a-a815-9865852163a7. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Instance network_info: |[{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.neutron [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Refreshing network info cache for port f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Start _get_guest_xml network_info=[{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:04:43 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:04:43 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-283502106',display_name='tempest-ServerActionsTestOtherA-server-283502106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-283502106',id=14,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-q1km4ag9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=1e185be0-50d7-4243-89a7-6c68c8707947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e185be0-50d7-4243-89a7-6c68c8707947 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:04:43 user nova-compute[74429]:   <uuid>1e185be0-50d7-4243-89a7-6c68c8707947</uuid>
Oct 23 20:04:43 user nova-compute[74429]:   <name>instance-0000000e</name>
Oct 23 20:04:43 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:04:43 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:04:43 user nova-compute[74429]:   <metadata>
Oct 23 20:04:43 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:04:43 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:04:43 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherA-server-283502106</nova:name>
Oct 23 20:04:43 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:04:43</nova:creationTime>
Oct 23 20:04:43 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:04:43 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:04:43 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:04:43 user nova-compute[74429]:       <nova:owner>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:user uuid="80ac3c2700c2447993ba5a8e14db0aa5">tempest-ServerActionsTestOtherA-1925715908-project-member</nova:user>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:project uuid="3f8768b24d954f5cbb03c242e6a3a1f1">tempest-ServerActionsTestOtherA-1925715908</nova:project>
Oct 23 20:04:43 user nova-compute[74429]:       </nova:owner>
Oct 23 20:04:43 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:04:43 user nova-compute[74429]:       <nova:ports>
Oct 23 20:04:43 user nova-compute[74429]:         <nova:port uuid="f2a7aa16-4b78-440a-a815-9865852163a7">
Oct 23 20:04:43 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 20:04:43 user nova-compute[74429]:         </nova:port>
Oct 23 20:04:43 user nova-compute[74429]:       </nova:ports>
Oct 23 20:04:43 user nova-compute[74429]:     </nova:instance>
Oct 23 20:04:43 user nova-compute[74429]:   </metadata>
Oct 23 20:04:43 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:04:43 user nova-compute[74429]:     <system>
Oct 23 20:04:43 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:04:43 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:04:43 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:04:43 user nova-compute[74429]:       <entry name="serial">1e185be0-50d7-4243-89a7-6c68c8707947</entry>
Oct 23 20:04:43 user nova-compute[74429]:       <entry name="uuid">1e185be0-50d7-4243-89a7-6c68c8707947</entry>
Oct 23 20:04:43 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:04:43 user nova-compute[74429]:     </system>
Oct 23 20:04:43 user nova-compute[74429]:   </sysinfo>
Oct 23 20:04:43 user nova-compute[74429]:   <os>
Oct 23 20:04:43 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:04:43 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:04:43 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:04:43 user nova-compute[74429]:   </os>
Oct 23 20:04:43 user nova-compute[74429]:   <features>
Oct 23 20:04:43 user nova-compute[74429]:     <acpi/>
Oct 23 20:04:43 user nova-compute[74429]:     <apic/>
Oct 23 20:04:43 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:04:43 user nova-compute[74429]:   </features>
Oct 23 20:04:43 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:04:43 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:04:43 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:04:43 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:04:43 user nova-compute[74429]:   </clock>
Oct 23 20:04:43 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:04:43 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:04:43 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:04:43 user nova-compute[74429]:   </cpu>
Oct 23 20:04:43 user nova-compute[74429]:   <devices>
Oct 23 20:04:43 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:04:43 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:04:43 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk"/>
Oct 23 20:04:43 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:04:43 user nova-compute[74429]:     </disk>
Oct 23 20:04:43 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:04:43 user nova-compute[74429]:       <mac address="fa:16:3e:e2:ce:b5"/>
Oct 23 20:04:43 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:04:43 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:04:43 user nova-compute[74429]:       <target dev="tapf2a7aa16-4b"/>
Oct 23 20:04:43 user nova-compute[74429]:     </interface>
Oct 23 20:04:43 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:04:43 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/console.log" append="off"/>
Oct 23 20:04:43 user nova-compute[74429]:     </serial>
Oct 23 20:04:43 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:04:43 user nova-compute[74429]:     <video>
Oct 23 20:04:43 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:04:43 user nova-compute[74429]:     </video>
Oct 23 20:04:43 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:04:43 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:04:43 user nova-compute[74429]:     </rng>
Oct 23 20:04:43 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:04:43 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:04:43 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:04:43 user nova-compute[74429]:     </memballoon>
Oct 23 20:04:43 user nova-compute[74429]:   </devices>
Oct 23 20:04:43 user nova-compute[74429]: </domain>
Oct 23 20:04:43 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-283502106',display_name='tempest-ServerActionsTestOtherA-server-283502106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-283502106',id=14,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-q1km4ag9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=1e185be0-50d7-4243-89a7-6c68c8707947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG os_vif [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac71e1db-f9f5-55be-a214-023e918a28e6', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2a7aa16-4b, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2a7aa16-4b, col_values=(('qos', UUID('7bd62406-8526-48f1-ab93-dfe5f011bdec')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2a7aa16-4b, col_values=(('external_ids', {'iface-id': 'f2a7aa16-4b78-440a-a815-9865852163a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ce:b5', 'vm-uuid': '1e185be0-50d7-4243-89a7-6c68c8707947'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:04:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:43 user nova-compute[74429]: INFO os_vif [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b')
Oct 23 20:04:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:04:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No VIF found with MAC fa:16:3e:e2:ce:b5, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:04:44 user nova-compute[74429]: DEBUG nova.network.neutron [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updated VIF entry in instance network info cache for port f2a7aa16-4b78-440a-a815-9865852163a7. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:04:44 user nova-compute[74429]: DEBUG nova.network.neutron [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fa237a19-ab3e-41da-9ef1-82fd521a68b9 req-8892cdd4-8709-44df-b4fc-f98d320b158e service nova] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-2d3fda2c-9cb0-4aab-8407-1a0853f7a62f req-5daf7ea7-691d-43f2-968e-4e585d0c8127 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2d3fda2c-9cb0-4aab-8407-1a0853f7a62f req-5daf7ea7-691d-43f2-968e-4e585d0c8127 service nova] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2d3fda2c-9cb0-4aab-8407-1a0853f7a62f req-5daf7ea7-691d-43f2-968e-4e585d0c8127 service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2d3fda2c-9cb0-4aab-8407-1a0853f7a62f req-5daf7ea7-691d-43f2-968e-4e585d0c8127 service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-2d3fda2c-9cb0-4aab-8407-1a0853f7a62f req-5daf7ea7-691d-43f2-968e-4e585d0c8127 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] No waiting events found dispatching network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:04:45 user nova-compute[74429]: WARNING nova.compute.manager [req-2d3fda2c-9cb0-4aab-8407-1a0853f7a62f req-5daf7ea7-691d-43f2-968e-4e585d0c8127 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received unexpected event network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 for instance with vm_state building and task_state spawning.
Oct 23 20:04:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-d47b69c7-aaf1-4df5-bb64-77f5e170bb31 req-7c76f531-cc97-48f2-908e-cacdfc91e4d5 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d47b69c7-aaf1-4df5-bb64-77f5e170bb31 req-7c76f531-cc97-48f2-908e-cacdfc91e4d5 service nova] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d47b69c7-aaf1-4df5-bb64-77f5e170bb31 req-7c76f531-cc97-48f2-908e-cacdfc91e4d5 service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d47b69c7-aaf1-4df5-bb64-77f5e170bb31 req-7c76f531-cc97-48f2-908e-cacdfc91e4d5 service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-d47b69c7-aaf1-4df5-bb64-77f5e170bb31 req-7c76f531-cc97-48f2-908e-cacdfc91e4d5 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] No waiting events found dispatching network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:04:47 user nova-compute[74429]: WARNING nova.compute.manager [req-d47b69c7-aaf1-4df5-bb64-77f5e170bb31 req-7c76f531-cc97-48f2-908e-cacdfc91e4d5 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received unexpected event network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 for instance with vm_state building and task_state spawning.
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:04:47 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Instance spawned successfully.
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:04:47 user nova-compute[74429]: INFO nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 23 20:04:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:04:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:47 user nova-compute[74429]: INFO nova.compute.manager [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Took 6.37 seconds to build instance.
Oct 23 20:04:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b42fea1a-a031-48bd-a6f4-a064f4dc4962 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.496s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a41ae88-9f6c-47c4-a7d5-e2501228b313', 'attached_at': '', 'detached_at': '', 'volume_id': '252d8f78-24fa-45e4-a44f-8676d9b67328', 'serial': '252d8f78-24fa-45e4-a44f-8676d9b67328'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcTwnEjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'd465c885-efdd-4eca-8338-0c6cf285c21a'}, 'status': 'reserved', 'instance': '1a41ae88-9f6c-47c4-a7d5-e2501228b313', 'attached_at': '', 'detached_at': '', 'volume_id': 'd465c885-efdd-4eca-8338-0c6cf285c21a', 'serial'} {{(pid=74429) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:49 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:49 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:49 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:04:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:49 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[908e2c85-1780-474c-8457-9e1b7ab6d7ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:04:49 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[37effacd-b0b8-4bf4-8f1b-f63b36642351]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328] added
Oct 23 20:04:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7728c-c6af-4aa1-ab24-924f5bdd325d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[401edc41-9e97-44a1-bc0e-776b926a1bfd]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yitSuaUo {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yitSuaUo" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[405327ba-3c67-4f63-a540-512db7a36875]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yitSuaUo'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d627579-d516-40fd-8455-3dcd2d9fc58f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed51e30-603c-43b9-8898-e544ec1f65de]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:49 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:49 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:49 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:49 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:49 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:49 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fa84a-44da-473f-84d1-cd9d9ccfab1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]
Oct 23 20:04:50 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.
Oct 23 20:04:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a252bc5-5217-4fcb-9dd6-2b388538e314]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bdbc27-1ac2-435f-86dd-71ac218376d1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:50 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: INFO nova.virt.block_device [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Booting with volume 7c73d2a6-7aed-419c-8a72-d6b257b9c3bc at /dev/vdb
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34fa45f-155c-49f0-8c54-2c64c9a65971]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.utils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1d879a-1fbe-4907-abc9-6e84223077ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac75af-216b-419a-8474-42a197adab3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[57812d68-aae5-4f49-89a0-bbbf545416af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53aed63-8652-4a30-babc-b71d2ce861c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:04:50 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:04:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e8728-3f81-429a-b64b-31c677db3596]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG os_brick.utils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:50 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating existing volume attachment record: 23fbf489-1ea4-405d-871d-f63840abae0f {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23633353630393235', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633353630393235', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.423s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:51 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lazy-loading 'flavor' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169eea4-0116-4cab-a693-e8336a71ccf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:04:51 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e4e7c-2c04-4927-9482-7d8cfbd45c1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0] added
Oct 23 20:04:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[727bcebf-2ad4-4498-ab94-69b96379c285]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2cd86-d95f-4c16-bde6-ff41b1781d67]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Zfxzdcph {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Zfxzdcph" returned: 0 in 0.065s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d77e03f-113b-4430-b804-65a545f0bc7f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Zfxzdcph'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e90a20f-4d04-4f71-b88b-be5b838fc35d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e640be1-ced4-4183-8148-dd79cd8cafb4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d1595-d963-4ce2-86d4-e723043a9c39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]
Oct 23 20:04:51 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.
Oct 23 20:04:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c5963f-4526-40fc-baac-469b59fe5976]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6358b42f-0dd0-41d3-a28e-9317b4c6b9d9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:04:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71db29-1d64-4117-9b92-12b55db476fd]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:04:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 58720256 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== connect_volume: return (2857ms) {'type': 'block', 'scsi_wwn': '23430333333363239', 'path': '/dev/sde'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430333333363239', 'path': '/dev/sde'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG nova.objects.instance [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'flavor' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:04:52 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:04:52 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:04:52 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:04:52 user nova-compute[74429]:   <serial>c7ff430d-b88f-48f3-81c0-888a3f5c75d0</serial>
Oct 23 20:04:52 user nova-compute[74429]: </disk>
Oct 23 20:04:52 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 207618048 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No VIF found with MAC fa:16:3e:7f:dd:c6, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 355467264 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdaa83c1-db12-49ed-8153-263eab6f868e tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.137s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 519045120 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 653262848 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 723517440 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 854589440 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 931135488 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Stashing vm_state: active {{(pid=74429) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcTwnEjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'd465c885-efdd-4eca-8338-0c6cf285c21a'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:56 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15a4a40-7946-4abb-97f2-6d24c9c91c85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:04:56 user nova-compute[74429]: No targets found.
Oct 23 20:04:56 user nova-compute[74429]: iSNS:
Oct 23 20:04:56 user nova-compute[74429]: No targets found.
Oct 23 20:04:56 user nova-compute[74429]: STATIC:
Oct 23 20:04:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:04:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:04:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a
Oct 23 20:04:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:04:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:04:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:04:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:56 user nova-compute[74429]: FIRMWARE:
Oct 23 20:04:56 user nova-compute[74429]: No targets found.
Oct 23 20:04:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:04:56 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:04:56 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92e493a-a2ed-4bbc-97ae-fbcbe0b09495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a338d4d-3e8d-4179-ae58-1ccb7dd60d84]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:04:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580b35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[52174d9c-df30-4cde-a9f0-847aaf9c89c0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d733d-9369-41c9-ba30-ba5dc038167d]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:04:56 user nova-compute[74429]: INFO nova.compute.claims [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Claim successful on node user
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb51c8a-bc4d-452a-8bbd-31f361a5d285]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: INFO nova.compute.resource_tracker [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating resource usage from migration e679dfeb-0806-4495-b18d-dc1374152eb7
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.075s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c9751c-bcc6-4ebf-ae46-2eaa928e1292]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bafe995-8479-4e1e-b703-071e4ac39e15]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba1aa54-8c30-43d3-96a2-97c6e8910eb4]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260]
Oct 23 20:04:56 user nova-compute[74429]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a, portal: 172.16.0.220,3260] successful.
Oct 23 20:04:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c885-efdd-4eca-8338-0c6cf285c21a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff1c99-61ad-4d58-b056-cc28c9c2ad2a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] <== disconnect_volume: return (432ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1a41ae88-9f6c-47c4-a7d5-e2501228b313', 'attached_at': '', 'detached_at': '', 'volume_id': '252d8f78-24fa-45e4-a44f-8676d9b67328', 'serial'} {{(pid=74429) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] swap_volume: removing Cinder connection for volume d465c885-efdd-4eca-8338-0c6cf285c21a {{(pid=74429) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.517s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:57 user nova-compute[74429]: INFO nova.compute.manager [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Migrating
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:57 user nova-compute[74429]: INFO nova.compute.rpcapi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Starting migrate_disk_and_power_off {{(pid=74429) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 20:04:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] swap_volume: Updating volume d465c885-efdd-4eca-8338-0c6cf285c21a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yitSuaUo", "auth_password": "lTQOHXsR4uC7o3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "252d8f78-24fa-45e4-a44f-8676d9b67328"}, "status": "reserved", "instance": "1a41ae88-9f6c-47c4-a7d5-e2501228b313", "attached_at": "", "detached_at": "", "volume_id": "252d8f78-24fa-45e4-a44f-8676d9b67328", "serial": "252d8f78-24fa-45e4-a44f-8676d9b67328"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '252d8f78-24fa-45e4-a44f-8676d9b67328', 'no_device': None, 'attachment_id': '95dcf0df-81c4-4757-a60b-a57e0453ae4f'} {{(pid=74429) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c91b8ef6-f814-49d4-9d7e-37c14f38f5b5 tempest-TestVolumeSwap-1300954125 tempest-TestVolumeSwap-1300954125-project-admin] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 69.353s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c1e0fd7-138f-4eed-8830-ef776c2dc07b req-8b8d6334-a880-4468-9824-6d359bb10b89 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c1e0fd7-138f-4eed-8830-ef776c2dc07b req-8b8d6334-a880-4468-9824-6d359bb10b89 service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c1e0fd7-138f-4eed-8830-ef776c2dc07b req-8b8d6334-a880-4468-9824-6d359bb10b89 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c1e0fd7-138f-4eed-8830-ef776c2dc07b req-8b8d6334-a880-4468-9824-6d359bb10b89 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c1e0fd7-138f-4eed-8830-ef776c2dc07b req-8b8d6334-a880-4468-9824-6d359bb10b89 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:04:58 user nova-compute[74429]: WARNING nova.compute.manager [req-3c1e0fd7-138f-4eed-8830-ef776c2dc07b req-8b8d6334-a880-4468-9824-6d359bb10b89 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state resize_migrating.
Oct 23 20:04:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance destroyed successfully.
Oct 23 20:04:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6a5270f-79, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ccb4486-4c68-41ee-835e-bbd334fb1ce6) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:04:58 user nova-compute[74429]: INFO os_vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79')
Oct 23 20:04:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:04:58 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b51f119-0377-480e-b24e-75534e37e3e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:04:58 user nova-compute[74429]: No targets found.
Oct 23 20:04:58 user nova-compute[74429]: iSNS:
Oct 23 20:04:58 user nova-compute[74429]: No targets found.
Oct 23 20:04:58 user nova-compute[74429]: STATIC:
Oct 23 20:04:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:04:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:04:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:04:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:04:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:58 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:04:58 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:04:58 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:04:58 user nova-compute[74429]: FIRMWARE:
Oct 23 20:04:58 user nova-compute[74429]: No targets found.
Oct 23 20:04:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:04:58 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:04:58 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e9b64-f760-4c91-9054-195c681c358d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20aa3a9-4939-40a9-a345-e1e16d6486d9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:04:58 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5057dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0'): ({'sde'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Removing single pathed devices sde {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fa5bba-75cb-4520-892b-c16ee2a6a4ce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[252e3c9a-28b5-4c10-b3c6-c6fc0ae24c24]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flushing IO for device /dev/sde {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfae9a6-03e6-4533-ab16-39514b1412e5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:04:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e355f9-c8b3-4f20-97fb-085a6a5ea38b]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8956866d-9547-4b79-a013-122a4b0e161b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671bd64-eb79-4f06-b15f-6bca142f932f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]
Oct 23 20:04:59 user nova-compute[74429]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.
Oct 23 20:04:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[665bea86-7dd2-48f1-b497-5d553b42c996]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== disconnect_volume: return (355ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: INFO nova.compute.manager [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Detaching volume 252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:04:59 user nova-compute[74429]: INFO nova.virt.block_device [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Attempting to driver detach volume 252d8f78-24fa-45e4-a44f-8676d9b67328 from mountpoint /dev/vdb
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Attempting to detach device vdb from instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:04:59 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:04:59 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:04:59 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:04:59 user nova-compute[74429]:   <serial>252d8f78-24fa-45e4-a44f-8676d9b67328</serial>
Oct 23 20:04:59 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:04:59 user nova-compute[74429]: </disk>
Oct 23 20:04:59 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:04:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Successfully detached device vdb from instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 from the persistent domain config.
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:04:59 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:04:59 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:04:59 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:04:59 user nova-compute[74429]:   <serial>252d8f78-24fa-45e4-a44f-8676d9b67328</serial>
Oct 23 20:04:59 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:04:59 user nova-compute[74429]: </disk>
Oct 23 20:04:59 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c_resize/disk /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "cp -r /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c_resize/disk /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk" returned: 0 in 0.296s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c_resize/disk.info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk.info {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "cp -r /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c_resize/disk.info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk.info" returned: 0 in 0.034s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:04:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:05:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-364e54e7-82fe-47a2-b9f4-98b5abaf5534 req-0f8d7f10-3635-4002-91fb-aa650cc22250 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-364e54e7-82fe-47a2-b9f4-98b5abaf5534 req-0f8d7f10-3635-4002-91fb-aa650cc22250 service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-364e54e7-82fe-47a2-b9f4-98b5abaf5534 req-0f8d7f10-3635-4002-91fb-aa650cc22250 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-364e54e7-82fe-47a2-b9f4-98b5abaf5534 req-0f8d7f10-3635-4002-91fb-aa650cc22250 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-364e54e7-82fe-47a2-b9f4-98b5abaf5534 req-0f8d7f10-3635-4002-91fb-aa650cc22250 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:00 user nova-compute[74429]: WARNING nova.compute.manager [req-364e54e7-82fe-47a2-b9f4-98b5abaf5534 req-0f8d7f10-3635-4002-91fb-aa650cc22250 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state resize_migrating.
Oct 23 20:05:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Port a6a5270f-79da-4735-a1f4-5bc0fac5259d binding to destination host user is already ACTIVE {{(pid=74429) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG os_brick.utils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d22ef-a89b-4d23-9c38-eab9d927b16f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ee933-9ea7-49a0-bf13-5d6e20b3847d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e399c5-c813-4c94-8e0d-88ba7edfb0fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdb1816-1b90-49ad-946a-2bf8805b1c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:05:02 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:05:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b70bfed-e65d-4bcd-bcca-2132be862430]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:05:02 user nova-compute[74429]: DEBUG os_brick.utils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:05 user nova-compute[74429]: INFO nova.compute.manager [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Terminating instance
Oct 23 20:05:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-28c38a68-f18d-4dcc-b26e-4863232e6379 req-f5b76ac3-b5d0-478e-97a7-56ed70b1e81e service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-unplugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28c38a68-f18d-4dcc-b26e-4863232e6379 req-f5b76ac3-b5d0-478e-97a7-56ed70b1e81e service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28c38a68-f18d-4dcc-b26e-4863232e6379 req-f5b76ac3-b5d0-478e-97a7-56ed70b1e81e service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28c38a68-f18d-4dcc-b26e-4863232e6379 req-f5b76ac3-b5d0-478e-97a7-56ed70b1e81e service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-28c38a68-f18d-4dcc-b26e-4863232e6379 req-f5b76ac3-b5d0-478e-97a7-56ed70b1e81e service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-unplugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-28c38a68-f18d-4dcc-b26e-4863232e6379 req-f5b76ac3-b5d0-478e-97a7-56ed70b1e81e service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-unplugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:05:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Instance destroyed successfully.
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lazy-loading 'resources' on Instance uuid 18e01426-64cf-4ca4-90b6-58e17f80242c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-234378906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-21309619',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYaIxZ7haGHQMD2Sc8iBoGdZU3kvelcOBgu+qFikPLl+VRRGeDnKWY3kG8gozWbDIfd0wVL3Fo7n6yEXtY6YFq0e1EKglNJL7sWOSRs01CeH9d99XcJG2Pv5Mb2uI6tQ==',key_name='tempest-keypair-40106845',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b589e45483454d7a90358486b8226198',ramdisk_id='',reservation_id='r-c80lshri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1521560130',owner_user_name='tempest-ServerActionsV293TestJSON-1521560130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4f293bc56648d1a664c7487f868607',uuid=18e01426-64cf-4ca4-90b6-58e17f80242c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converting VIF {"id": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "address": "fa:16:3e:1b:15:d1", "network": {"id": "98a0c3b5-7cbf-46b8-ac50-553282bb9b78", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1757116580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b589e45483454d7a90358486b8226198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8176bc-f9", "ovs_interfaceid": "8b8176bc-f9da-4a7a-a3c1-14a69c90959c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_vif [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8176bc-f9, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22a05cc9-6a24-4e9e-8b00-67fb7676f02e) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:06 user nova-compute[74429]: INFO os_vif [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:15:d1,bridge_name='br-int',has_traffic_filtering=True,id=8b8176bc-f9da-4a7a-a3c1-14a69c90959c,network=Network(98a0c3b5-7cbf-46b8-ac50-553282bb9b78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8176bc-f9')
Oct 23 20:05:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJdQBFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:06 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5601e76e-de3b-4565-be0d-05fbaad6dde1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:05:06 user nova-compute[74429]: No targets found.
Oct 23 20:05:06 user nova-compute[74429]: iSNS:
Oct 23 20:05:06 user nova-compute[74429]: No targets found.
Oct 23 20:05:06 user nova-compute[74429]: STATIC:
Oct 23 20:05:06 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:05:06 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:06 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:06 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:05:06 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:06 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:06 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:05:06 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:06 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:06 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64
Oct 23 20:05:06 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:06 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:06 user nova-compute[74429]: FIRMWARE:
Oct 23 20:05:06 user nova-compute[74429]: No targets found.
Oct 23 20:05:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:05:06 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:05:06 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:05:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2e75e-2277-47f1-871d-cab379db0205]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0fc87e-6211-49b6-bbe7-80688a58f9b1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:07 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:05:07 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:07 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:05:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:07 user nova-compute[74429]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 (non-flash)
Oct 23 20:05:07 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:07 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:05:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d504501f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64'): ({'sdh'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Removing single pathed devices sdh {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77333f6-9c67-4b22-b1f9-2264eea66b5b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[63604de5-36f6-4227-a3ff-47fbabe6aea1]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Flushing IO for device /dev/sdh {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2c1cc-e58a-4e16-92b4-f3cae530aebe]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af939b-1e8b-42ba-aee8-e0a5e99feffb]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] SCSI volumes sdh have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObb0c16c4-47affd33392bd9fa', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bb0c16c4', '/dev/disk/by-id/scsi-23437616666643333') {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[73476ad5-08e4-44ec-8a42-78846e214097]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7acb3-2621-4012-b97b-420a1d5864b3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c403497c-5355-4673-99a8-23d5818e3f1d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260]
Oct 23 20:05:07 user nova-compute[74429]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64, portal: 172.16.0.220,3260] successful.
Oct 23 20:05:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05e591c-4315-4349-8f87-450ba1215d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4071c0-a89c-420b-97fd-d02eb3d77bc2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] <== disconnect_volume: return (419ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:05:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Deleting instance files /opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c_del
Oct 23 20:05:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Deletion of /opt/stack/data/nova/instances/18e01426-64cf-4ca4-90b6-58e17f80242c_del complete
Oct 23 20:05:07 user nova-compute[74429]: INFO nova.compute.manager [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:05:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:08 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:08 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Took 0.73 seconds to deallocate network for instance.
Oct 23 20:05:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-928f2011-9bb2-4e9b-b3ae-49af32d5ad8d req-ce1cf4ad-4dbb-42dc-84d7-09439b571baa service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-deleted-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-f8fa6c0e-d6a3-41a6-88c5-113a6c2d9ad5 req-aec5b60e-61e3-4356-80c2-8d299b3a9aaf service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f8fa6c0e-d6a3-41a6-88c5-113a6c2d9ad5 req-aec5b60e-61e3-4356-80c2-8d299b3a9aaf service nova] Acquiring lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f8fa6c0e-d6a3-41a6-88c5-113a6c2d9ad5 req-aec5b60e-61e3-4356-80c2-8d299b3a9aaf service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f8fa6c0e-d6a3-41a6-88c5-113a6c2d9ad5 req-aec5b60e-61e3-4356-80c2-8d299b3a9aaf service nova] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-f8fa6c0e-d6a3-41a6-88c5-113a6c2d9ad5 req-aec5b60e-61e3-4356-80c2-8d299b3a9aaf service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] No waiting events found dispatching network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:08 user nova-compute[74429]: WARNING nova.compute.manager [req-f8fa6c0e-d6a3-41a6-88c5-113a6c2d9ad5 req-aec5b60e-61e3-4356-80c2-8d299b3a9aaf service nova] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Received unexpected event network-vif-plugged-8b8176bc-f9da-4a7a-a3c1-14a69c90959c for instance with vm_state active and task_state deleting.
Oct 23 20:05:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:05:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:16 user nova-compute[74429]: INFO nova.virt.block_device [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Booting with volume bc551201-4f08-41f4-b82a-bb9e6aef03cf at /dev/vdc
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:16 user nova-compute[74429]: DEBUG os_brick.utils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b6fce-f579-444a-a7b6-4f2eda8678cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c8ab8-a3ad-4af2-a2a3-1e4ae1592c4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a786795-bd70-4063-ae0d-f37d04b54e3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cafe1e-8859-4536-931c-01d71fb1889b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:05:17 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002fef4-3f8c-4113-80f8-89a83f650d27]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG os_brick.utils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating existing volume attachment record: ce368ae0-aca7-48c4-81ea-b15d76431fb9 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:05:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:18 user nova-compute[74429]: INFO nova.compute.manager [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] instance snapshotting
Oct 23 20:05:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Beginning live snapshot process
Oct 23 20:05:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7798MB free_disk=25.496517181396484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:05:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Applying migration context for instance 44034c15-e9c6-466b-959a-534b818bab5c as it has an incoming, in-progress migration e679dfeb-0806-4495-b18d-dc1374152eb7. Migration status is post-migrating {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 20:05:19 user nova-compute[74429]: INFO nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating resource usage from migration e679dfeb-0806-4495-b18d-dc1374152eb7
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:19 user nova-compute[74429]: INFO nova.compute.manager [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Took 11.06 seconds to detach 1 volumes for instance.
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] [instance: 18e01426-64cf-4ca4-90b6-58e17f80242c] Deleting volume: e05e591c-4315-4349-8f87-450ba1215d64 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 18e01426-64cf-4ca4-90b6-58e17f80242c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b02494e7-5fd0-4a23-ae27-252fdea795c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Migration e679dfeb-0806-4495-b18d-dc1374152eb7 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8vv2kd0i/86a287f8ce024e69a43a5dc7d47805d2.delta 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8vv2kd0i/86a287f8ce024e69a43a5dc7d47805d2.delta 1073741824" returned: 0 in 0.051s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:19 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.070s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.507s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:19 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:05:19 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 is timed out.
Oct 23 20:05:19 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Successfully detached device vdb from instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 from the live domain config.
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yitSuaUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '252d8f78-24fa-45e4-a44f-8676d9b67328'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:20 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f48b65-0d94-45cc-b4a4-9e592d018aad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:05:20 user nova-compute[74429]: No targets found.
Oct 23 20:05:20 user nova-compute[74429]: iSNS:
Oct 23 20:05:20 user nova-compute[74429]: No targets found.
Oct 23 20:05:20 user nova-compute[74429]: STATIC:
Oct 23 20:05:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:05:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328
Oct 23 20:05:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:20 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:05:20 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:05:20 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:05:20 user nova-compute[74429]: FIRMWARE:
Oct 23 20:05:20 user nova-compute[74429]: No targets found.
Oct 23 20:05:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:05:20 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:05:20 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[450c06e5-7f57-41c3-b739-1a9bcac103f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ec10d9-5337-481c-a46c-306ec8c41f30]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:20 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:20 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:05:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:20 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:20 user nova-compute[74429]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 (non-flash)
Oct 23 20:05:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5057da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd5fe07-803f-486e-beae-58a91db29a17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297bcea-7daf-4b6c-b955-219b281cdb29]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13bf604-5f65-4ee6-89ad-26f22f11b492]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064803f-ff8d-454c-96db-76d4c5174df4]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f73985-afa4-403f-8f7c-44b880570ac4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --logout" returned: 0 in 0.257s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d482956-7e43-4688-8f16-91e0b17ce5b4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260]
Oct 23 20:05:20 user nova-compute[74429]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328, portal: 172.16.0.220,3260] successful.
Oct 23 20:05:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252d8f78-24fa-45e4-a44f-8676d9b67328 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae391b0-d3bf-4535-b859-0f679b66b1c0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.569s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] <== disconnect_volume: return (571ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.677s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:20 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Deleted allocations for instance 18e01426-64cf-4ca4-90b6-58e17f80242c
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c3174c9c-a8cb-4ce2-babc-953b69a84ad4 tempest-ServerActionsV293TestJSON-1521560130 tempest-ServerActionsV293TestJSON-1521560130-project-member] Lock "18e01426-64cf-4ca4-90b6-58e17f80242c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.975s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:05:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Skipping network cache update for instance because it is Building. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:05:21 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid dc41e78e-050f-429e-b0b9-f4473a07c2c7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8vv2kd0i/86a287f8ce024e69a43a5dc7d47805d2.delta /opt/stack/data/nova/instances/snapshots/tmp8vv2kd0i/86a287f8ce024e69a43a5dc7d47805d2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8vv2kd0i/86a287f8ce024e69a43a5dc7d47805d2.delta /opt/stack/data/nova/instances/snapshots/tmp8vv2kd0i/86a287f8ce024e69a43a5dc7d47805d2" returned: 0 in 0.362s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:21 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Snapshot extracted, beginning image upload
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.objects.instance [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lazy-loading 'flavor' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1b067973-8721-494b-9955-7389a8d4d657 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.341s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updating instance_info_cache with network_info: [{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:21 user nova-compute[74429]: WARNING nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid dc41e78e-050f-429e-b0b9-f4473a07c2c7 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 1e185be0-50d7-4243-89a7-6c68c8707947 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "44034c15-e9c6-466b-959a-534b818bab5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: INFO nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "44034c15-e9c6-466b-959a-534b818bab5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: INFO nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] During sync_power_state the instance has a pending task (image_uploading). Skip.
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:05:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Starting finish_migration {{(pid=74429) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:05:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Creating image(s)
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk. size=21474836480 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk 21474836480 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk 21474836480" returned: 0 in 0.048s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Ensure instance console log exists: /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start _get_guest_xml network_info=[{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'f74fcaee-1f86-4050-a2eb-1bfb5d24f1f1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '44034c15-e9c6-466b-959a-534b818bab5c', 'attached_at': '2023-10-23T20:05:22.000000', 'detached_at': '', 'volume_id': 'c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'serial': 'c7ff430d-b88f-48f3-81c0-888a3f5c75d0'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:05:22 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:22 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:22 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:22 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:22 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c341c4-f9c5-4068-9be6-edddd6722bf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:05:22 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbe785a-c068-4038-896c-735c053f38b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0] added
Oct 23 20:05:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c254ed0-7287-425d-b27b-02b31d3bd0c6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba4f4f3-ede6-412a-a271-a3c9f36a16b2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Zfxzdcph {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Zfxzdcph" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f0326e-d47c-4a35-be9f-a7976f0f097c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Zfxzdcph'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e33754a-533f-4a69-ac9a-23e23d25a2af]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e94fcd4-67ce-459f-bf06-7d7a6f7d77ac]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:22 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:22 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e136d0-79fb-4b10-95b1-ceb9379de388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]
Oct 23 20:05:22 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.
Oct 23 20:05:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[494fb818-9fad-4290-b509-78c71641c617]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b57586-2be8-4b8f-9cbf-4ad8601922f9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:22 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:22 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:22 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:22 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf14de-0bde-4737-9bcd-5aa132da3fb7]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:05:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:05:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23430333333363239', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430333333363239', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:05:24 user nova-compute[74429]:   <uuid>44034c15-e9c6-466b-959a-534b818bab5c</uuid>
Oct 23 20:05:24 user nova-compute[74429]:   <name>instance-00000003</name>
Oct 23 20:05:24 user nova-compute[74429]:   <memory>2097152</memory>
Oct 23 20:05:24 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:05:24 user nova-compute[74429]:   <metadata>
Oct 23 20:05:24 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:05:24 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:05:24 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherB-server-594920033</nova:name>
Oct 23 20:05:24 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:05:22</nova:creationTime>
Oct 23 20:05:24 user nova-compute[74429]:       <nova:flavor name="m1.small">
Oct 23 20:05:24 user nova-compute[74429]:         <nova:memory>2048</nova:memory>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:disk>20</nova:disk>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:05:24 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:05:24 user nova-compute[74429]:       <nova:owner>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:user uuid="9dc4633f95ff40f4a2859c6673112f94">tempest-ServerActionsTestOtherB-1184256079-project-member</nova:user>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:project uuid="f07fe256e3f84a4594ecccfc011aeea3">tempest-ServerActionsTestOtherB-1184256079</nova:project>
Oct 23 20:05:24 user nova-compute[74429]:       </nova:owner>
Oct 23 20:05:24 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:05:24 user nova-compute[74429]:       <nova:ports>
Oct 23 20:05:24 user nova-compute[74429]:         <nova:port uuid="a6a5270f-79da-4735-a1f4-5bc0fac5259d">
Oct 23 20:05:24 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 20:05:24 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:24 user nova-compute[74429]:       </nova:ports>
Oct 23 20:05:24 user nova-compute[74429]:     </nova:instance>
Oct 23 20:05:24 user nova-compute[74429]:   </metadata>
Oct 23 20:05:24 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:05:24 user nova-compute[74429]:     <system>
Oct 23 20:05:24 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:05:24 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:05:24 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:05:24 user nova-compute[74429]:       <entry name="serial">44034c15-e9c6-466b-959a-534b818bab5c</entry>
Oct 23 20:05:24 user nova-compute[74429]:       <entry name="uuid">44034c15-e9c6-466b-959a-534b818bab5c</entry>
Oct 23 20:05:24 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:05:24 user nova-compute[74429]:     </system>
Oct 23 20:05:24 user nova-compute[74429]:   </sysinfo>
Oct 23 20:05:24 user nova-compute[74429]:   <os>
Oct 23 20:05:24 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:05:24 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:05:24 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:05:24 user nova-compute[74429]:   </os>
Oct 23 20:05:24 user nova-compute[74429]:   <features>
Oct 23 20:05:24 user nova-compute[74429]:     <acpi/>
Oct 23 20:05:24 user nova-compute[74429]:     <apic/>
Oct 23 20:05:24 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:05:24 user nova-compute[74429]:   </features>
Oct 23 20:05:24 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:05:24 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:05:24 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:05:24 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:05:24 user nova-compute[74429]:   </clock>
Oct 23 20:05:24 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:05:24 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:05:24 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:05:24 user nova-compute[74429]:   </cpu>
Oct 23 20:05:24 user nova-compute[74429]:   <devices>
Oct 23 20:05:24 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:05:24 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:05:24 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk"/>
Oct 23 20:05:24 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:05:24 user nova-compute[74429]:     </disk>
Oct 23 20:05:24 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:05:24 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:05:24 user nova-compute[74429]:       <source dev="/dev/sdc"/>
Oct 23 20:05:24 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:05:24 user nova-compute[74429]:       <serial>c7ff430d-b88f-48f3-81c0-888a3f5c75d0</serial>
Oct 23 20:05:24 user nova-compute[74429]:     </disk>
Oct 23 20:05:24 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:24 user nova-compute[74429]:       <mac address="fa:16:3e:7f:dd:c6"/>
Oct 23 20:05:24 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:24 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:24 user nova-compute[74429]:       <target dev="tapa6a5270f-79"/>
Oct 23 20:05:24 user nova-compute[74429]:     </interface>
Oct 23 20:05:24 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:05:24 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/console.log" append="off"/>
Oct 23 20:05:24 user nova-compute[74429]:     </serial>
Oct 23 20:05:24 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:05:24 user nova-compute[74429]:     <video>
Oct 23 20:05:24 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:24 user nova-compute[74429]:     </video>
Oct 23 20:05:24 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:05:24 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:05:24 user nova-compute[74429]:     </rng>
Oct 23 20:05:24 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:05:24 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:05:24 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:05:24 user nova-compute[74429]:     </memballoon>
Oct 23 20:05:24 user nova-compute[74429]:   </devices>
Oct 23 20:05:24 user nova-compute[74429]: </domain>
Oct 23 20:05:24 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-961027824-network", "vif_mac": "fa:16:3e:7f:dd:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG os_vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a222e76b-f9d5-5518-8b11-6361cb36abf8', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6a5270f-79, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6a5270f-79, col_values=(('qos', UUID('42b4e2b6-c7a1-4953-b13d-2de3ebe6391d')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6a5270f-79, col_values=(('external_ids', {'iface-id': 'a6a5270f-79da-4735-a1f4-5bc0fac5259d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:dd:c6', 'vm-uuid': '44034c15-e9c6-466b-959a-534b818bab5c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:24 user nova-compute[74429]: INFO os_vif [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79')
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] No VIF found with MAC fa:16:3e:7f:dd:c6, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:05:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Snapshot image upload complete
Oct 23 20:05:24 user nova-compute[74429]: INFO nova.compute.manager [None req-499e56f6-50b1-4398-861d-02da5744ea6d tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Took 6.25 seconds to snapshot the instance on the hypervisor.
Oct 23 20:05:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-d47359ce-b734-48e9-a60b-d33920884260 req-6166e74c-987c-4c64-a49c-0d6cfbf5e01d service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d47359ce-b734-48e9-a60b-d33920884260 req-6166e74c-987c-4c64-a49c-0d6cfbf5e01d service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d47359ce-b734-48e9-a60b-d33920884260 req-6166e74c-987c-4c64-a49c-0d6cfbf5e01d service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d47359ce-b734-48e9-a60b-d33920884260 req-6166e74c-987c-4c64-a49c-0d6cfbf5e01d service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-d47359ce-b734-48e9-a60b-d33920884260 req-6166e74c-987c-4c64-a49c-0d6cfbf5e01d service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:25 user nova-compute[74429]: WARNING nova.compute.manager [req-d47359ce-b734-48e9-a60b-d33920884260 req-6166e74c-987c-4c64-a49c-0d6cfbf5e01d service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state resize_finish.
Oct 23 20:05:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:05:27 user nova-compute[74429]: INFO nova.compute.claims [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Claim successful on node user
Oct 23 20:05:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-0121ab99-6166-4bc7-aff1-4e31302d669b req-9ff54e30-ed8a-4203-993e-9f1cc30fefff service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0121ab99-6166-4bc7-aff1-4e31302d669b req-9ff54e30-ed8a-4203-993e-9f1cc30fefff service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0121ab99-6166-4bc7-aff1-4e31302d669b req-9ff54e30-ed8a-4203-993e-9f1cc30fefff service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0121ab99-6166-4bc7-aff1-4e31302d669b req-9ff54e30-ed8a-4203-993e-9f1cc30fefff service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-0121ab99-6166-4bc7-aff1-4e31302d669b req-9ff54e30-ed8a-4203-993e-9f1cc30fefff service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:27 user nova-compute[74429]: WARNING nova.compute.manager [req-0121ab99-6166-4bc7-aff1-4e31302d669b req-9ff54e30-ed8a-4203-993e-9f1cc30fefff service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state resize_finish.
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:05:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance running successfully.
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Failed to set time: agent not configured {{(pid=74429) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c203cae0-a627-4166-bd29-03797033cc34 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] finish_migration finished successfully. {{(pid=74429) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:05:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.policy [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c600566c5fef49bdabb57bc0f8233049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74dd7809fa6b4cf185a02e8ffc0f5439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:05:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Creating image(s)
Oct 23 20:05:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "/opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "/opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "df94a9d75b3d9a0dd79c9ecdc65e3d715632f973" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "df94a9d75b3d9a0dd79c9ecdc65e3d715632f973" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:29 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Successfully created port: 3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.part --force-share --output=json" returned: 0 in 0.266s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.virt.images [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] eb9ee1b1-f223-4691-978d-9bb470a2c377 was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.part /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.part /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.converted" returned: 0 in 0.300s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "df94a9d75b3d9a0dd79c9ecdc65e3d715632f973" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.965s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Successfully updated port: 3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquired lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-changed-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Refreshing instance network info cache due to event network-changed-3692c2a8-df8e-48f8-b286-dcb406283c67. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] Acquiring lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973 --force-share --output=json" returned: 0 in 0.274s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "df94a9d75b3d9a0dd79c9ecdc65e3d715632f973" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "df94a9d75b3d9a0dd79c9ecdc65e3d715632f973" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973 --force-share --output=json" returned: 0 in 0.232s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973,backing_fmt=raw /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973,backing_fmt=raw /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk 1073741824" returned: 0 in 0.121s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "df94a9d75b3d9a0dd79c9ecdc65e3d715632f973" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updating instance_info_cache with network_info: [{"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973 --force-share --output=json" returned: 0 in 0.278s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Ensure instance console log exists: /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Releasing lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Instance network_info: |[{"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] Acquired lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.network.neutron [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Refreshing network info cache for port 3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Start _get_guest_xml network_info=[{"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='62f83e6de1d966def82e246a8b3c363a',container_format='bare',created_at=2023-10-23T20:05:18Z,direct_url=<?>,disk_format='qcow2',id=eb9ee1b1-f223-4691-978d-9bb470a2c377,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-955586297',owner='74dd7809fa6b4cf185a02e8ffc0f5439',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T20:05:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'eb9ee1b1-f223-4691-978d-9bb470a2c377'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:05:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='62f83e6de1d966def82e246a8b3c363a',container_format='bare',created_at=2023-10-23T20:05:18Z,direct_url=<?>,disk_format='qcow2',id=eb9ee1b1-f223-4691-978d-9bb470a2c377,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-955586297',owner='74dd7809fa6b4cf185a02e8ffc0f5439',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T20:05:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1477910682',display_name='tempest-TestStampPattern-server-1477910682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1477910682',id=15,image_ref='eb9ee1b1-f223-4691-978d-9bb470a2c377',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UEGx8zY0R42EfuCAeeZ9GcoX+fKO6uxcXyPESeKU8tZbyBeoCemxWqY8zrVqk2YCKJ1oYbgTDCWR7zsf+i7gwTf2tIe3iSvwUxABB+ro2StTbFJpgMxD50UDdJ16VlQ==',key_name='tempest-TestStampPattern-310945430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74dd7809fa6b4cf185a02e8ffc0f5439',ramdisk_id='',reservation_id='r-emflse78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853',image_min_disk='1',image_min_ram='0',image_owner_id='74dd7809fa6b4cf185a02e8ffc0f5439',image_owner_project_name='tempest-TestStampPattern-1617962097',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1617962097-project-member',image_user_id='c600566c5fef49bdabb57bc0f8233049',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617962097',owner_user_name='tempest-TestStampPattern-1617962097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:05:29Z,user_data=None,user_id='c600566c5fef49bdabb57bc0f8233049',uuid=2bd6dbca-177e-4289-ac29-c7b114f72d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converting VIF {"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bd6dbca-177e-4289-ac29-c7b114f72d00 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:05:31 user nova-compute[74429]:   <uuid>2bd6dbca-177e-4289-ac29-c7b114f72d00</uuid>
Oct 23 20:05:31 user nova-compute[74429]:   <name>instance-0000000f</name>
Oct 23 20:05:31 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:05:31 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:05:31 user nova-compute[74429]:   <metadata>
Oct 23 20:05:31 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:05:31 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:05:31 user nova-compute[74429]:       <nova:name>tempest-TestStampPattern-server-1477910682</nova:name>
Oct 23 20:05:31 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:05:31</nova:creationTime>
Oct 23 20:05:31 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:05:31 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:05:31 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:05:31 user nova-compute[74429]:       <nova:owner>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:user uuid="c600566c5fef49bdabb57bc0f8233049">tempest-TestStampPattern-1617962097-project-member</nova:user>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:project uuid="74dd7809fa6b4cf185a02e8ffc0f5439">tempest-TestStampPattern-1617962097</nova:project>
Oct 23 20:05:31 user nova-compute[74429]:       </nova:owner>
Oct 23 20:05:31 user nova-compute[74429]:       <nova:root type="image" uuid="eb9ee1b1-f223-4691-978d-9bb470a2c377"/>
Oct 23 20:05:31 user nova-compute[74429]:       <nova:ports>
Oct 23 20:05:31 user nova-compute[74429]:         <nova:port uuid="3692c2a8-df8e-48f8-b286-dcb406283c67">
Oct 23 20:05:31 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 20:05:31 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:31 user nova-compute[74429]:       </nova:ports>
Oct 23 20:05:31 user nova-compute[74429]:     </nova:instance>
Oct 23 20:05:31 user nova-compute[74429]:   </metadata>
Oct 23 20:05:31 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:05:31 user nova-compute[74429]:     <system>
Oct 23 20:05:31 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:05:31 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:05:31 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:05:31 user nova-compute[74429]:       <entry name="serial">2bd6dbca-177e-4289-ac29-c7b114f72d00</entry>
Oct 23 20:05:31 user nova-compute[74429]:       <entry name="uuid">2bd6dbca-177e-4289-ac29-c7b114f72d00</entry>
Oct 23 20:05:31 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:05:31 user nova-compute[74429]:     </system>
Oct 23 20:05:31 user nova-compute[74429]:   </sysinfo>
Oct 23 20:05:31 user nova-compute[74429]:   <os>
Oct 23 20:05:31 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:05:31 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:05:31 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:05:31 user nova-compute[74429]:   </os>
Oct 23 20:05:31 user nova-compute[74429]:   <features>
Oct 23 20:05:31 user nova-compute[74429]:     <acpi/>
Oct 23 20:05:31 user nova-compute[74429]:     <apic/>
Oct 23 20:05:31 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:05:31 user nova-compute[74429]:   </features>
Oct 23 20:05:31 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:05:31 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:05:31 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:05:31 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:05:31 user nova-compute[74429]:   </clock>
Oct 23 20:05:31 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:05:31 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:05:31 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:05:31 user nova-compute[74429]:   </cpu>
Oct 23 20:05:31 user nova-compute[74429]:   <devices>
Oct 23 20:05:31 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:05:31 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:05:31 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk"/>
Oct 23 20:05:31 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:05:31 user nova-compute[74429]:     </disk>
Oct 23 20:05:31 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:31 user nova-compute[74429]:       <mac address="fa:16:3e:da:12:d3"/>
Oct 23 20:05:31 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:31 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:31 user nova-compute[74429]:       <target dev="tap3692c2a8-df"/>
Oct 23 20:05:31 user nova-compute[74429]:     </interface>
Oct 23 20:05:31 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:05:31 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/console.log" append="off"/>
Oct 23 20:05:31 user nova-compute[74429]:     </serial>
Oct 23 20:05:31 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:05:31 user nova-compute[74429]:     <video>
Oct 23 20:05:31 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:31 user nova-compute[74429]:     </video>
Oct 23 20:05:31 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:05:31 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:05:31 user nova-compute[74429]:     </rng>
Oct 23 20:05:31 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:05:31 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:05:31 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:05:31 user nova-compute[74429]:     </memballoon>
Oct 23 20:05:31 user nova-compute[74429]:   </devices>
Oct 23 20:05:31 user nova-compute[74429]: </domain>
Oct 23 20:05:31 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1477910682',display_name='tempest-TestStampPattern-server-1477910682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1477910682',id=15,image_ref='eb9ee1b1-f223-4691-978d-9bb470a2c377',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UEGx8zY0R42EfuCAeeZ9GcoX+fKO6uxcXyPESeKU8tZbyBeoCemxWqY8zrVqk2YCKJ1oYbgTDCWR7zsf+i7gwTf2tIe3iSvwUxABB+ro2StTbFJpgMxD50UDdJ16VlQ==',key_name='tempest-TestStampPattern-310945430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74dd7809fa6b4cf185a02e8ffc0f5439',ramdisk_id='',reservation_id='r-emflse78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853',image_min_disk='1',image_min_ram='0',image_owner_id='74dd7809fa6b4cf185a02e8ffc0f5439',image_owner_project_name='tempest-TestStampPattern-1617962097',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1617962097-project-member',image_user_id='c600566c5fef49bdabb57bc0f8233049',network_allocated='True',owner_project_name='tempest-TestStampPattern-1617962097',owner_user_name='tempest-TestStampPattern-1617962097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:05:29Z,user_data=None,user_id='c600566c5fef49bdabb57bc0f8233049',uuid=2bd6dbca-177e-4289-ac29-c7b114f72d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converting VIF {"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG os_vif [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05490999-218f-5157-8f27-1b6c0b49c2df', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3692c2a8-df, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3692c2a8-df, col_values=(('qos', UUID('2e397c9e-1d74-4af1-b880-d40391fb0699')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3692c2a8-df, col_values=(('external_ids', {'iface-id': '3692c2a8-df8e-48f8-b286-dcb406283c67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:12:d3', 'vm-uuid': '2bd6dbca-177e-4289-ac29-c7b114f72d00'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:31 user nova-compute[74429]: INFO os_vif [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df')
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No VIF found with MAC fa:16:3e:da:12:d3, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:05:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updated VIF entry in instance network info cache for port 3692c2a8-df8e-48f8-b286-dcb406283c67. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:05:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updating instance_info_cache with network_info: [{"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6c1380d7-de93-48eb-8277-a7f3186343ff req-b8936d93-a66b-42bf-89bd-364db8be72dd service nova] Releasing lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-b8263600-bfe5-479c-9e0d-74f393526555 req-647242c1-39a9-4179-ba30-e4d1b7d1c262 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b8263600-bfe5-479c-9e0d-74f393526555 req-647242c1-39a9-4179-ba30-e4d1b7d1c262 service nova] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b8263600-bfe5-479c-9e0d-74f393526555 req-647242c1-39a9-4179-ba30-e4d1b7d1c262 service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b8263600-bfe5-479c-9e0d-74f393526555 req-647242c1-39a9-4179-ba30-e4d1b7d1c262 service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-b8263600-bfe5-479c-9e0d-74f393526555 req-647242c1-39a9-4179-ba30-e4d1b7d1c262 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] No waiting events found dispatching network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:33 user nova-compute[74429]: WARNING nova.compute.manager [req-b8263600-bfe5-479c-9e0d-74f393526555 req-647242c1-39a9-4179-ba30-e4d1b7d1c262 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received unexpected event network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 for instance with vm_state building and task_state spawning.
Oct 23 20:05:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd1552e8-ab65-4d6b-87e6-dd70bb01c1b4 req-aa57f91e-3ab0-4a5b-b68e-ec484d9adcb8 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd1552e8-ab65-4d6b-87e6-dd70bb01c1b4 req-aa57f91e-3ab0-4a5b-b68e-ec484d9adcb8 service nova] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd1552e8-ab65-4d6b-87e6-dd70bb01c1b4 req-aa57f91e-3ab0-4a5b-b68e-ec484d9adcb8 service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dd1552e8-ab65-4d6b-87e6-dd70bb01c1b4 req-aa57f91e-3ab0-4a5b-b68e-ec484d9adcb8 service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd1552e8-ab65-4d6b-87e6-dd70bb01c1b4 req-aa57f91e-3ab0-4a5b-b68e-ec484d9adcb8 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] No waiting events found dispatching network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:35 user nova-compute[74429]: WARNING nova.compute.manager [req-dd1552e8-ab65-4d6b-87e6-dd70bb01c1b4 req-aa57f91e-3ab0-4a5b-b68e-ec484d9adcb8 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received unexpected event network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 for instance with vm_state building and task_state spawning.
Oct 23 20:05:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:05:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:05:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Instance spawned successfully.
Oct 23 20:05:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:05:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:05:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:05:36 user nova-compute[74429]: INFO nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Took 7.57 seconds to spawn the instance on the hypervisor.
Oct 23 20:05:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:05:36 user nova-compute[74429]: INFO nova.compute.manager [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Took 8.77 seconds to build instance.
Oct 23 20:05:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d59a07a2-c74b-4419-9e06-20b84a45c487 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.918s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:40 user nova-compute[74429]: INFO nova.compute.manager [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Unrescuing
Oct 23 20:05:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:05:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:40 user nova-compute[74429]: DEBUG nova.objects.instance [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'flavor' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-fc4a05bc-926a-4f31-b22e-c1aaaf8b4f06 req-4bcdc534-4d82-4392-92ab-ab704ff596fa service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc4a05bc-926a-4f31-b22e-c1aaaf8b4f06 req-4bcdc534-4d82-4392-92ab-ab704ff596fa service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc4a05bc-926a-4f31-b22e-c1aaaf8b4f06 req-4bcdc534-4d82-4392-92ab-ab704ff596fa service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc4a05bc-926a-4f31-b22e-c1aaaf8b4f06 req-4bcdc534-4d82-4392-92ab-ab704ff596fa service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-fc4a05bc-926a-4f31-b22e-c1aaaf8b4f06 req-4bcdc534-4d82-4392-92ab-ab704ff596fa service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:41 user nova-compute[74429]: WARNING nova.compute.manager [req-fc4a05bc-926a-4f31-b22e-c1aaaf8b4f06 req-4bcdc534-4d82-4392-92ab-ab704ff596fa service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:05:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:41 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance destroyed successfully.
Oct 23 20:05:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:43 user nova-compute[74429]: WARNING nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:05:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing instance network info cache due to event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:43 user nova-compute[74429]: DEBUG nova.network.neutron [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG nova.network.neutron [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updated VIF entry in instance network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG nova.network.neutron [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing instance network info cache due to event network-changed-2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Acquiring lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Acquired lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:44 user nova-compute[74429]: DEBUG nova.network.neutron [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Refreshing network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updated VIF entry in instance network info cache for port 2d3359d2-106a-4f09-a6e7-d5cafc924c2b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [{"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3aa50ab9-6ba8-4f8e-a8d2-0e4475e0ecf9 req-77efe434-df34-49f4-a5a8-2613ec420699 service nova] Releasing lock "refresh_cache-a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-60938fc7-1f10-4fef-846f-bd8b9cff210e req-e60f441b-5126-43cb-86fe-9d939ced17c2 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-60938fc7-1f10-4fef-846f-bd8b9cff210e req-e60f441b-5126-43cb-86fe-9d939ced17c2 service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-60938fc7-1f10-4fef-846f-bd8b9cff210e req-e60f441b-5126-43cb-86fe-9d939ced17c2 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-60938fc7-1f10-4fef-846f-bd8b9cff210e req-e60f441b-5126-43cb-86fe-9d939ced17c2 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-60938fc7-1f10-4fef-846f-bd8b9cff210e req-e60f441b-5126-43cb-86fe-9d939ced17c2 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:45 user nova-compute[74429]: WARNING nova.compute.manager [req-60938fc7-1f10-4fef-846f-bd8b9cff210e req-e60f441b-5126-43cb-86fe-9d939ced17c2 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:05:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-bd1e3da2-cbeb-45d5-9f47-4ea97b100b0f tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:05:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-de1d9a9a-a5ac-45f0-85f5-eb304227b67d req-d35fd7d3-ee95-457a-a7db-0ef16ae881d1 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de1d9a9a-a5ac-45f0-85f5-eb304227b67d req-d35fd7d3-ee95-457a-a7db-0ef16ae881d1 service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de1d9a9a-a5ac-45f0-85f5-eb304227b67d req-d35fd7d3-ee95-457a-a7db-0ef16ae881d1 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de1d9a9a-a5ac-45f0-85f5-eb304227b67d req-d35fd7d3-ee95-457a-a7db-0ef16ae881d1 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-de1d9a9a-a5ac-45f0-85f5-eb304227b67d req-d35fd7d3-ee95-457a-a7db-0ef16ae881d1 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:48 user nova-compute[74429]: WARNING nova.compute.manager [req-de1d9a9a-a5ac-45f0-85f5-eb304227b67d req-d35fd7d3-ee95-457a-a7db-0ef16ae881d1 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state active and task_state None.
Oct 23 20:05:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:49 user nova-compute[74429]: INFO nova.compute.manager [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Terminating instance
Oct 23 20:05:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-e0dc0e69-282b-4b90-9a7d-168176fc8fb3 req-ca85705d-824a-4c6f-b937-3546f32ffc6d service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-vif-unplugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e0dc0e69-282b-4b90-9a7d-168176fc8fb3 req-ca85705d-824a-4c6f-b937-3546f32ffc6d service nova] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e0dc0e69-282b-4b90-9a7d-168176fc8fb3 req-ca85705d-824a-4c6f-b937-3546f32ffc6d service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e0dc0e69-282b-4b90-9a7d-168176fc8fb3 req-ca85705d-824a-4c6f-b937-3546f32ffc6d service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-e0dc0e69-282b-4b90-9a7d-168176fc8fb3 req-ca85705d-824a-4c6f-b937-3546f32ffc6d service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] No waiting events found dispatching network-vif-unplugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-e0dc0e69-282b-4b90-9a7d-168176fc8fb3 req-ca85705d-824a-4c6f-b937-3546f32ffc6d service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-vif-unplugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:05:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Creating image(s)
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Ensure instance console log exists: /opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Start _get_guest_xml network_info=[{"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '7e59f9fa-deaa-4e00-a24a-ba6a3b68bd7e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsqNxeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc', 'attached_at': '', 'detached_at': '', 'volume_id': '09551b16-04fa-4c0c-bde5-232823622573', 'serial': '09551b16-04fa-4c0c-bde5-232823622573'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '23fbf489-1ea4-405d-871d-f63840abae0f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxWpdhSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc', 'attached_at': '', 'detached_at': '', 'volume_id': '7c73d2a6-7aed-419c-8a72-d6b257b9c3bc', 'serial': '7c73d2a6-7aed-419c-8a72-d6b257b9c3bc'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'ce368ae0-aca7-48c4-81ea-b15d76431fb9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcCbGeuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc551201-4f08-41f4-b82a-bb9e6aef03cf', 'serial': 'bc551201-4f08-41f4-b82a-bb9e6aef03cf'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:05:50 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:50 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsqNxeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:50 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:50 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:50 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc59968-38d1-46ee-a91a-14964a5dcdde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:05:50 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:05:50 user nova-compute[74429]: INFO nova.compute.claims [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Claim successful on node user
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de76d795-babc-41b7-b77f-01a5d270b045]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573] added
Oct 23 20:05:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c40ea02-4606-49df-b9ae-c69bf9e74aa7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c92c24-2cca-4dac-9f5f-f05f9737180d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTsqNxeX {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTsqNxeX" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49f6bbe-2403-4c9f-b07e-e099548f8894]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iTsqNxeX'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda7fd5-4a43-43d1-8226-baff77f6988d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bcdbaa-126e-43fc-b8e0-9adebeceb1e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Instance destroyed successfully.
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lazy-loading 'resources' on Instance uuid 1a41ae88-9f6c-47c4-a7d5-e2501228b313 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae982e4-0317-4170-9d0c-36875948ce42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260]
Oct 23 20:05:50 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260] successful.
Oct 23 20:05:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1962566548',display_name='tempest-TestVolumeSwap-server-1962566548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1962566548',id=7,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCoIclRbGzWX92UjS8C7mra1IvqMtlDIOvYIQf4dfS+dXv1JQMeAFrQsX4AdtWmDsXOXfb5PknGOTLGNgv/LNDoZ0keTNEjkS6p9+m+p5qjeuyaKW4+ZkAR9woCj7URyA==',key_name='tempest-keypair-1036448723',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b7e46063e9946b5b4f868cd9205a0b2',ramdisk_id='',reservation_id='r-tq9nyk33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1162461156',owner_user_name='tempest-TestVolumeSwap-1162461156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4e3fa8f8f134ad7b01e1c391e8d6b9a',uuid=1a41ae88-9f6c-47c4-a7d5-e2501228b313,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Converting VIF {"id": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "address": "fa:16:3e:c3:27:8e", "network": {"id": "8a952989-409c-41ee-a0b1-27c35465fcc8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1075475156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7e46063e9946b5b4f868cd9205a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4157a0b7-da", "ovs_interfaceid": "4157a0b7-da9e-4379-b63e-8d7305dbf6b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_vif [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4157a0b7-da, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88c5b215-e06e-4808-a7f2-9378858835a5) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2aca68-ecc9-4f7a-831f-5ed05c74e568]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:50 user nova-compute[74429]: INFO os_vif [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:8e,bridge_name='br-int',has_traffic_filtering=True,id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1,network=Network(8a952989-409c-41ee-a0b1-27c35465fcc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4157a0b7-da')
Oct 23 20:05:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Deleting instance files /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313_del
Oct 23 20:05:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Deletion of /opt/stack/data/nova/instances/1a41ae88-9f6c-47c4-a7d5-e2501228b313_del complete
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8a3d33-b601-49c4-94a7-355db0af56b1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[45837cbb-a2ea-4fe4-8f7f-6a0da4cb9e64]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:05:50 user nova-compute[74429]: INFO nova.compute.manager [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 23 20:05:50 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:05:50 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:05:51 user nova-compute[74429]: INFO nova.compute.manager [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Rescuing
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquired lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.785s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:05:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.policy [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce4aa1886f044d3bb7c952632b48047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121e72c37c4fa5acfd0f568fc1153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:05:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Creating image(s)
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.238s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsqNxeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23731383066373230', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731383066373230', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxWpdhSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:51 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:51 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ba273-39ab-4c80-9a87-7badaac101dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:05:51 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd4941-19ab-4412-8e7b-78d8c7ac078c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc] added
Oct 23 20:05:51 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.205s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b50600-4e96-4d8e-977c-2ec33ae2a1c5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk 1073741824" returned: 0 in 0.071s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6de8e89-3f30-4021-b929-3b34e44fdd84]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxWpdhSi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxWpdhSi" returned: 0 in 0.035s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a056b-763e-4dc6-8900-a6c51871b7bf]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Releasing lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxWpdhSi'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4de7e7-2e18-4947-8d14-9ba930c139cb]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-244b55f3-00c2-430a-a3c1-9eb24a0da7b1 req-b1e0212d-a6f5-4e6f-ab0a-2a0d61a803ca service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-vif-deleted-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:52 user nova-compute[74429]: INFO nova.compute.manager [req-244b55f3-00c2-430a-a3c1-9eb24a0da7b1 req-b1e0212d-a6f5-4e6f-ab0a-2a0d61a803ca service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Neutron deleted interface 4157a0b7-da9e-4379-b63e-8d7305dbf6b1; detaching it from the instance and deleting it from the info cache
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.network.neutron [req-244b55f3-00c2-430a-a3c1-9eb24a0da7b1 req-b1e0212d-a6f5-4e6f-ab0a-2a0d61a803ca service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ab427-be20-4543-b312-aa7d2d43e208]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Took 1.49 seconds to deallocate network for instance.
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-c62591ed-466b-4d3b-90b9-b0afd3297c7f req-04bee306-67ed-4d24-b360-b65edd0f98c6 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received event network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c62591ed-466b-4d3b-90b9-b0afd3297c7f req-04bee306-67ed-4d24-b360-b65edd0f98c6 service nova] Acquiring lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c62591ed-466b-4d3b-90b9-b0afd3297c7f req-04bee306-67ed-4d24-b360-b65edd0f98c6 service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c62591ed-466b-4d3b-90b9-b0afd3297c7f req-04bee306-67ed-4d24-b360-b65edd0f98c6 service nova] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-c62591ed-466b-4d3b-90b9-b0afd3297c7f req-04bee306-67ed-4d24-b360-b65edd0f98c6 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] No waiting events found dispatching network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:52 user nova-compute[74429]: WARNING nova.compute.manager [req-c62591ed-466b-4d3b-90b9-b0afd3297c7f req-04bee306-67ed-4d24-b360-b65edd0f98c6 service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Received unexpected event network-vif-plugged-4157a0b7-da9e-4379-b63e-8d7305dbf6b1 for instance with vm_state active and task_state deleting.
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-244b55f3-00c2-430a-a3c1-9eb24a0da7b1 req-b1e0212d-a6f5-4e6f-ab0a-2a0d61a803ca service nova] [instance: 1a41ae88-9f6c-47c4-a7d5-e2501228b313] Detach interface failed, port_id=4157a0b7-da9e-4379-b63e-8d7305dbf6b1, reason: Instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Successfully created port: d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.305s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69784a-ce73-48bf-bba5-97a0928f1210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260]
Oct 23 20:05:52 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260] successful.
Oct 23 20:05:52 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c9527-6bd6-4cfe-9830-2352d2007787]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ffe5da-8fe1-43d2-9d18-cc8782c9a1af]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:52 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:52 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:52 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.598s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f04c326-c7e0-452a-9ed8-f4726292858e]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxWpdhSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Cannot resize image /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance destroyed successfully.
Oct 23 20:05:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Attempting a stable device rescue
Oct 23 20:05:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74429) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:05:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Creating image(s)
Oct 23 20:05:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "/opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "/opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "/opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "04ace2f22f5e0233a05090b93fc2a9a3f6cc6302" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "04ace2f22f5e0233a05090b93fc2a9a3f6cc6302" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.797s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:53 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Deleted allocations for instance 1a41ae88-9f6c-47c4-a7d5-e2501228b313
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.783s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== connect_volume: return (2788ms) {'type': 'block', 'scsi_wwn': '23265646262646165', 'path': '/dev/sde'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265646262646165', 'path': '/dev/sde'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Successfully updated port: d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e0d03446-f34e-4d7d-bd48-cb3722cdada5 tempest-TestVolumeSwap-1162461156 tempest-TestVolumeSwap-1162461156-project-member] Lock "1a41ae88-9f6c-47c4-a7d5-e2501228b313" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.860s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:54 user nova-compute[74429]: WARNING nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state active and task_state rescuing.
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:54 user nova-compute[74429]: WARNING nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state active and task_state rescuing.
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-changed-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Refreshing instance network info cache due to event network-changed-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Acquiring lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Acquired lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.network.neutron [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Refreshing network info cache for port d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.network.neutron [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcCbGeuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:54 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:54 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:54 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.part --force-share --output=json" returned: 0 in 0.283s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.virt.images [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] 066f6d0b-7d2a-4f16-bca8-f68bb565d364 was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.part /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7441060-e426-4865-85f9-73a34f8a9045]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:05:54 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fbc7fa-df05-4bb9-8125-d4dddeaf8c13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf] added
Oct 23 20:05:54 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.neutron [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-96528a92-881b-49f6-a2f1-f92ec7a47b35 req-ac2f49d2-4ce3-42b7-8cb8-b51927fdaca2 service nova] Releasing lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquired lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.111s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3197729-09aa-44d8-bd2e-fc775b4553b8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[626fdb92-8c4a-4990-9d9f-8702f30d63af]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcCbGeuy {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OcCbGeuy" returned: 0 in 0.043s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae79a2-aec0-4e98-b814-7236979fdd42]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OcCbGeuy'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.part /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.converted" returned: 0 in 0.322s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca4cb3d-e7be-44b5-b770-0a1ddc45717d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbfb73f-0747-4e5c-984d-d0875099e0fa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0789f78-19aa-4081-a3f3-e47bbfa65067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260]
Oct 23 20:05:55 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260] successful.
Oct 23 20:05:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "04ace2f22f5e0233a05090b93fc2a9a3f6cc6302" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.256s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[98036b3e-2f61-4d05-8acc-07f57d8eb5b4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "04ace2f22f5e0233a05090b93fc2a9a3f6cc6302" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "04ace2f22f5e0233a05090b93fc2a9a3f6cc6302" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afb6c6b-bf62-43e4-b202-2214be008796]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:05:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:55 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:05:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.601s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3435e3b3-c54f-415b-a211-feea5af9d90a]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcCbGeuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Releasing lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance network_info: |[{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start _get_guest_xml network_info=[{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:05:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.instance [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'pci_devices' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302 --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302,backing_fmt=raw /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:05:55 user nova-compute[74429]:   <uuid>236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</uuid>
Oct 23 20:05:55 user nova-compute[74429]:   <name>instance-00000010</name>
Oct 23 20:05:55 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:05:55 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:05:55 user nova-compute[74429]:   <metadata>
Oct 23 20:05:55 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:05:55 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:05:55 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeTestJSON-server-2118326004</nova:name>
Oct 23 20:05:55 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:05:55</nova:creationTime>
Oct 23 20:05:55 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:05:55 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:05:55 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:05:55 user nova-compute[74429]:       <nova:owner>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:user uuid="9ce4aa1886f044d3bb7c952632b48047">tempest-AttachVolumeTestJSON-1733625309-project-member</nova:user>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:project uuid="f4121e72c37c4fa5acfd0f568fc1153d">tempest-AttachVolumeTestJSON-1733625309</nova:project>
Oct 23 20:05:55 user nova-compute[74429]:       </nova:owner>
Oct 23 20:05:55 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:05:55 user nova-compute[74429]:       <nova:ports>
Oct 23 20:05:55 user nova-compute[74429]:         <nova:port uuid="d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee">
Oct 23 20:05:55 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:05:55 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:55 user nova-compute[74429]:       </nova:ports>
Oct 23 20:05:55 user nova-compute[74429]:     </nova:instance>
Oct 23 20:05:55 user nova-compute[74429]:   </metadata>
Oct 23 20:05:55 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:05:55 user nova-compute[74429]:     <system>
Oct 23 20:05:55 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:05:55 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:05:55 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:05:55 user nova-compute[74429]:       <entry name="serial">236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</entry>
Oct 23 20:05:55 user nova-compute[74429]:       <entry name="uuid">236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</entry>
Oct 23 20:05:55 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:05:55 user nova-compute[74429]:     </system>
Oct 23 20:05:55 user nova-compute[74429]:   </sysinfo>
Oct 23 20:05:55 user nova-compute[74429]:   <os>
Oct 23 20:05:55 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:05:55 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:05:55 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:05:55 user nova-compute[74429]:   </os>
Oct 23 20:05:55 user nova-compute[74429]:   <features>
Oct 23 20:05:55 user nova-compute[74429]:     <acpi/>
Oct 23 20:05:55 user nova-compute[74429]:     <apic/>
Oct 23 20:05:55 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:05:55 user nova-compute[74429]:   </features>
Oct 23 20:05:55 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:05:55 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:05:55 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:05:55 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:05:55 user nova-compute[74429]:   </clock>
Oct 23 20:05:55 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:05:55 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:05:55 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:05:55 user nova-compute[74429]:   </cpu>
Oct 23 20:05:55 user nova-compute[74429]:   <devices>
Oct 23 20:05:55 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:05:55 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:05:55 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk"/>
Oct 23 20:05:55 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:05:55 user nova-compute[74429]:     </disk>
Oct 23 20:05:55 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:55 user nova-compute[74429]:       <mac address="fa:16:3e:88:c1:97"/>
Oct 23 20:05:55 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:55 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:55 user nova-compute[74429]:       <target dev="tapd0ec5a03-70"/>
Oct 23 20:05:55 user nova-compute[74429]:     </interface>
Oct 23 20:05:55 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:05:55 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/console.log" append="off"/>
Oct 23 20:05:55 user nova-compute[74429]:     </serial>
Oct 23 20:05:55 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:05:55 user nova-compute[74429]:     <video>
Oct 23 20:05:55 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:55 user nova-compute[74429]:     </video>
Oct 23 20:05:55 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:05:55 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:05:55 user nova-compute[74429]:     </rng>
Oct 23 20:05:55 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:05:55 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:05:55 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:05:55 user nova-compute[74429]:     </memballoon>
Oct 23 20:05:55 user nova-compute[74429]:   </devices>
Oct 23 20:05:55 user nova-compute[74429]: </domain>
Oct 23 20:05:55 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_vif [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302,backing_fmt=raw /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue" returned: 0 in 0.079s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7019e352-a2a1-59a7-9760-30d3412da451', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "04ace2f22f5e0233a05090b93fc2a9a3f6cc6302" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'migration_context' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ec5a03-70, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ec5a03-70, col_values=(('qos', UUID('9fcff314-c15f-42be-b55c-2ec30b27c2b9')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ec5a03-70, col_values=(('external_ids', {'iface-id': 'd0ec5a03-7054-4e1a-9b13-cb5b0f5862ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c1:97', 'vm-uuid': '236ad665-9dd8-4cb3-85cd-35f1b6a26b3a'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Object Instance<9901998c-ee34-4de9-b819-bc6c23bdfcdd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Start _get_guest_xml network_info=[{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "vif_mac": "fa:16:3e:e9:c8:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '066f6d0b-7d2a-4f16-bca8-f68bb565d364', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'be0fd16f-4bbb-4ffe-bafa-96a0b69358f5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '9901998c-ee34-4de9-b819-bc6c23bdfcdd', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'serial': 'ee7fb1f1-09e6-457f-8f31-1c3aff0a5658'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'resources' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Object Instance<9901998c-ee34-4de9-b819-bc6c23bdfcdd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'numa_topology' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:55 user nova-compute[74429]: INFO os_vif [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70')
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Object Instance<9901998c-ee34-4de9-b819-bc6c23bdfcdd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:05:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.objects.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Object Instance<9901998c-ee34-4de9-b819-bc6c23bdfcdd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:05:55 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No VIF found with MAC fa:16:3e:88:c1:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.654s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== connect_volume: return (1656ms) {'type': 'block', 'scsi_wwn': '23930363930636264', 'path': '/dev/sdf'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930363930636264', 'path': '/dev/sdf'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.669s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:56 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:05:56 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lazy-loading 'pci_devices' on Instance uuid 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0126577-45da-4509-a09b-1c7c6f121df6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HzLDEqie\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 20:05:56 user nova-compute[74429]: node.name = iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:05:56 user nova-compute[74429]: node.tpgt = -1
Oct 23 20:05:56 user nova-compute[74429]: node.startup = automatic
Oct 23 20:05:56 user nova-compute[74429]: node.leading_login = No
Oct 23 20:05:56 user nova-compute[74429]: iface.iscsi_ifacename = default
Oct 23 20:05:56 user nova-compute[74429]: iface.net_ifacename = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.ipaddress = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.prefix_len = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.hwaddress = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.transport_name = tcp
Oct 23 20:05:56 user nova-compute[74429]: iface.initiatorname = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.vlan_id = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.vlan_priority = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.vlan_state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.iface_num = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.mtu = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.port = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.bootproto = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.subnet_mask = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.gateway = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_alt_client_id = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_dns = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_learn_iqn = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_vendor_id_state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_vendor_id = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.dhcp_slp_da = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.fragmentation = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.gratuitous_arp = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.incoming_forwarding = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.tos_state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.tos = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.ttl = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.delayed_ack = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.tcp_nagle = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.tcp_wsf_state = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.tcp_wsf = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.tcp_timer_scale = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.tcp_timestamp = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.redirect = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.def_task_mgmt_timeout = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.header_digest = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.data_digest = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.immediate_data = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.initial_r2t = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.data_seq_inorder = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.data_pdu_inorder = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.erl = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.max_receive_data_len = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.first_burst_len = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.max_outstanding_r2t = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.max_burst_len = 0
Oct 23 20:05:56 user nova-compute[74429]: iface.chap_auth = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.bidi_chap = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.strict_login_compliance = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.discovery_auth = <empty>
Oct 23 20:05:56 user nova-compute[74429]: iface.discovery_logout = <empty>
Oct 23 20:05:56 user nova-compute[74429]: node.discovery_address = <empty>
Oct 23 20:05:56 user nova-compute[74429]: node.discovery_port = 0
Oct 23 20:05:56 user nova-compute[74429]: node.discovery_type = static
Oct 23 20:05:56 user nova-compute[74429]: node.session.initial_cmdsn = 0
Oct 23 20:05:56 user nova-compute[74429]: node.session.initial_login_retry_max = 8
Oct 23 20:05:56 user nova-compute[74429]: node.session.xmit_thread_priority = -20
Oct 23 20:05:56 user nova-compute[74429]: node.session.cmds_max = 128
Oct 23 20:05:56 user nova-compute[74429]: node.session.queue_depth = 32
Oct 23 20:05:56 user nova-compute[74429]: node.session.nr_sessions = 1
Oct 23 20:05:56 user nova-compute[74429]: node.session.auth.authmethod = CHAP
Oct 23 20:05:56 user nova-compute[74429]: node.session.auth.username = HzLDEqie
Oct 23 20:05:56 user nova-compute[74429]: node.session.auth.password = ***
Oct 23 20:05:56 user nova-compute[74429]: node.session.auth.username_in = <empty>
Oct 23 20:05:56 user nova-compute[74429]: node.session.auth.password_in = <empty>
Oct 23 20:05:56 user nova-compute[74429]: node.session.auth.chap_algs = MD5
Oct 23 20:05:56 user nova-compute[74429]: node.session.timeo.replacement_timeout = 120
Oct 23 20:05:56 user nova-compute[74429]: node.session.err_timeo.abort_timeout = 15
Oct 23 20:05:56 user nova-compute[74429]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 20:05:56 user nova-compute[74429]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 20:05:56 user nova-compute[74429]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.FastAbort = Yes
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.InitialR2T = No
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.ImmediateData = Yes
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.MaxConnections = 1
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 20:05:56 user nova-compute[74429]: node.session.iscsi.ERL = 0
Oct 23 20:05:56 user nova-compute[74429]: node.session.scan = manual
Oct 23 20:05:56 user nova-compute[74429]: node.session.reopen_max = 0
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].address = 172.16.0.220
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].port = 3260
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].startup = manual
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].tcp.window_size = 524288
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].tcp.type_of_service = 0
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].timeo.logout_timeout = 15
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].timeo.login_timeout = 15
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].timeo.auth_timeout = 45
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].iscsi.DataDigest = None
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].iscsi.IFMarker = No
Oct 23 20:05:56 user nova-compute[74429]: node.conn[0].iscsi.OFMarker = No
Oct 23 20:05:56 user nova-compute[74429]: # END RECORD
Oct 23 20:05:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:05:56 user nova-compute[74429]:   <uuid>53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc</uuid>
Oct 23 20:05:56 user nova-compute[74429]:   <name>instance-0000000c</name>
Oct 23 20:05:56 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:05:56 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:05:56 user nova-compute[74429]:   <metadata>
Oct 23 20:05:56 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:05:56 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:name>tempest-device-tagging-server-814297397</nova:name>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:05:50</nova:creationTime>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:05:56 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:05:56 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:owner>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:user uuid="34d78625b5d04ef4a79e9cd60c6b31d8">tempest-TaggedBootDevicesTest-429215706-project-member</nova:user>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:project uuid="bd293746ce9041b2a5a489f369e0d35b">tempest-TaggedBootDevicesTest-429215706</nova:project>
Oct 23 20:05:56 user nova-compute[74429]:       </nova:owner>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:ports>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="76a266f2-c5cd-4169-ab6a-ad14e115b3b4">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="08e047dc-b906-4f12-8376-5143320b2875">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="81536a66-6e9d-4fba-82aa-652c7b34e8c5">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="146d960d-25ab-46b0-b5ff-597a50999436">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="0a880b39-b14a-486d-802b-315e5802de34">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="b482176d-b452-4813-ad77-1ee2dc570b5d">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="6481d5aa-66b4-4ab0-a0af-78c41dacef13">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:       </nova:ports>
Oct 23 20:05:56 user nova-compute[74429]:     </nova:instance>
Oct 23 20:05:56 user nova-compute[74429]:   </metadata>
Oct 23 20:05:56 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:05:56 user nova-compute[74429]:     <system>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="serial">53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="uuid">53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:05:56 user nova-compute[74429]:     </system>
Oct 23 20:05:56 user nova-compute[74429]:   </sysinfo>
Oct 23 20:05:56 user nova-compute[74429]:   <os>
Oct 23 20:05:56 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:05:56 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:05:56 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:05:56 user nova-compute[74429]:   </os>
Oct 23 20:05:56 user nova-compute[74429]:   <features>
Oct 23 20:05:56 user nova-compute[74429]:     <acpi/>
Oct 23 20:05:56 user nova-compute[74429]:     <apic/>
Oct 23 20:05:56 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:05:56 user nova-compute[74429]:   </features>
Oct 23 20:05:56 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:05:56 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:05:56 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:05:56 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:05:56 user nova-compute[74429]:   </clock>
Oct 23 20:05:56 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:05:56 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:05:56 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:05:56 user nova-compute[74429]:   </cpu>
Oct 23 20:05:56 user nova-compute[74429]:   <devices>
Oct 23 20:05:56 user nova-compute[74429]:     <disk type="file" device="cdrom">
Oct 23 20:05:56 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 20:05:56 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc/disk.config"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="hda" bus="ide"/>
Oct 23 20:05:56 user nova-compute[74429]:     </disk>
Oct 23 20:05:56 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:05:56 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:05:56 user nova-compute[74429]:       <source dev="/dev/sdd"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <serial>09551b16-04fa-4c0c-bde5-232823622573</serial>
Oct 23 20:05:56 user nova-compute[74429]:     </disk>
Oct 23 20:05:56 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:05:56 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:05:56 user nova-compute[74429]:       <source dev="/dev/sde"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <serial>7c73d2a6-7aed-419c-8a72-d6b257b9c3bc</serial>
Oct 23 20:05:56 user nova-compute[74429]:     </disk>
Oct 23 20:05:56 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:05:56 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:05:56 user nova-compute[74429]:       <source dev="/dev/sdf"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="vdc" bus="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <serial>bc551201-4f08-41f4-b82a-bb9e6aef03cf</serial>
Oct 23 20:05:56 user nova-compute[74429]:     </disk>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:4a:80:30"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tap76a266f2-c5"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:ed:a6:f8"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tap08e047dc-b9"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:84:2d:07"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tap81536a66-6e"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:05:8c:08"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tap146d960d-25"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:cd:c6:f4"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tap0a880b39-b1"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:70:ee:96"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tapb482176d-b4"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:ed:86:93"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tap6481d5aa-66"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:05:56 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc/console.log" append="off"/>
Oct 23 20:05:56 user nova-compute[74429]:     </serial>
Oct 23 20:05:56 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:05:56 user nova-compute[74429]:     <video>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:     </video>
Oct 23 20:05:56 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:05:56 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:05:56 user nova-compute[74429]:     </rng>
Oct 23 20:05:56 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:05:56 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:05:56 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:05:56 user nova-compute[74429]:     </memballoon>
Oct 23 20:05:56 user nova-compute[74429]:   </devices>
Oct 23 20:05:56 user nova-compute[74429]: </domain>
Oct 23 20:05:56 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1a8d3-e227-413b-9da5-3cd7b24621c0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '340e9760-bc7c-5204-903f-fd1d0ce2d36d', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd0d5db-8be1-46b6-b1a7-2d9d28941af1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzLDEqie {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76a266f2-c5, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76a266f2-c5, col_values=(('qos', UUID('247e9292-e7b9-4a4e-a4cc-370132d3aca4')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76a266f2-c5, col_values=(('external_ids', {'iface-id': '76a266f2-c5cd-4169-ab6a-ad14e115b3b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:80:30', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzLDEqie" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[85850529-1eab-47c7-aff8-3bc281d41665]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HzLDEqie'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5')
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f207f0aa-1d25-5cb6-a8aa-8e70de25c7ac', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.081s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc423e-7874-4a66-96cc-5dfd43528345]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08e047dc-b9, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08e047dc-b9, col_values=(('qos', UUID('39a00dd3-bf30-45da-97ae-eeed79a57029')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08e047dc-b9, col_values=(('external_ids', {'iface-id': '08e047dc-b906-4f12-8376-5143320b2875', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a6:f8', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe1a583-951e-48f7-9943-e8e55ead53dd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:05:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:05:56 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:05:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] HCTL ('40', '0', '0', 0) found on session 15 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7187de2b-d8b1-4db2-a15c-1d9a0e83e3f4]: (4, ('0 0 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching for a device in session 15 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.307s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] <== connect_volume: return (976ms) {'type': 'block', 'scsi_wwn': '26462363833323936', 'path': '/dev/sdi'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462363833323936', 'path': '/dev/sdi'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9')
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c948fb5-cca6-5551-bc34-deb5a268a5d4', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843622581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843622581',id=11,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-n3ca9kmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:02Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=9901998c-ee34-4de9-b819-bc6c23bdfcdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "vif_mac": "fa:16:3e:e9:c8:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "vif_mac": "fa:16:3e:e9:c8:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'pci_devices' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.objects.base [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Object Instance<9901998c-ee34-4de9-b819-bc6c23bdfcdd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:05:56 user nova-compute[74429]:   <uuid>9901998c-ee34-4de9-b819-bc6c23bdfcdd</uuid>
Oct 23 20:05:56 user nova-compute[74429]:   <name>instance-0000000b</name>
Oct 23 20:05:56 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:05:56 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:05:56 user nova-compute[74429]:   <metadata>
Oct 23 20:05:56 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:05:56 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1843622581</nova:name>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:05:55</nova:creationTime>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:05:56 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:05:56 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:owner>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:user uuid="734b0b0d04104bfeab582780b77764cf">tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member</nova:user>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:project uuid="201753405b7c4553af3b39f82311a3d2">tempest-ServerBootFromVolumeStableRescueTest-1279644555</nova:project>
Oct 23 20:05:56 user nova-compute[74429]:       </nova:owner>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:05:56 user nova-compute[74429]:       <nova:ports>
Oct 23 20:05:56 user nova-compute[74429]:         <nova:port uuid="de2fe581-050a-4bab-aec1-15928e24366b">
Oct 23 20:05:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:05:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:05:56 user nova-compute[74429]:       </nova:ports>
Oct 23 20:05:56 user nova-compute[74429]:     </nova:instance>
Oct 23 20:05:56 user nova-compute[74429]:   </metadata>
Oct 23 20:05:56 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:05:56 user nova-compute[74429]:     <system>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="serial">9901998c-ee34-4de9-b819-bc6c23bdfcdd</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="uuid">9901998c-ee34-4de9-b819-bc6c23bdfcdd</entry>
Oct 23 20:05:56 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:05:56 user nova-compute[74429]:     </system>
Oct 23 20:05:56 user nova-compute[74429]:   </sysinfo>
Oct 23 20:05:56 user nova-compute[74429]:   <os>
Oct 23 20:05:56 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:05:56 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:05:56 user nova-compute[74429]:   </os>
Oct 23 20:05:56 user nova-compute[74429]:   <features>
Oct 23 20:05:56 user nova-compute[74429]:     <acpi/>
Oct 23 20:05:56 user nova-compute[74429]:     <apic/>
Oct 23 20:05:56 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:05:56 user nova-compute[74429]:   </features>
Oct 23 20:05:56 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:05:56 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:05:56 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:05:56 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:05:56 user nova-compute[74429]:   </clock>
Oct 23 20:05:56 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:05:56 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:05:56 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:05:56 user nova-compute[74429]:   </cpu>
Oct 23 20:05:56 user nova-compute[74429]:   <devices>
Oct 23 20:05:56 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:05:56 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:05:56 user nova-compute[74429]:       <source dev="/dev/sdi"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <serial>ee7fb1f1-09e6-457f-8f31-1c3aff0a5658</serial>
Oct 23 20:05:56 user nova-compute[74429]:     </disk>
Oct 23 20:05:56 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:05:56 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:05:56 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <boot order="1"/>
Oct 23 20:05:56 user nova-compute[74429]:     </disk>
Oct 23 20:05:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:05:56 user nova-compute[74429]:       <mac address="fa:16:3e:e9:c8:13"/>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:05:56 user nova-compute[74429]:       <target dev="tapde2fe581-05"/>
Oct 23 20:05:56 user nova-compute[74429]:     </interface>
Oct 23 20:05:56 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:05:56 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/console.log" append="off"/>
Oct 23 20:05:56 user nova-compute[74429]:     </serial>
Oct 23 20:05:56 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:05:56 user nova-compute[74429]:     <video>
Oct 23 20:05:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:05:56 user nova-compute[74429]:     </video>
Oct 23 20:05:56 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:05:56 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:05:56 user nova-compute[74429]:     </rng>
Oct 23 20:05:56 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:05:56 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:05:56 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:05:56 user nova-compute[74429]:     </memballoon>
Oct 23 20:05:56 user nova-compute[74429]:   </devices>
Oct 23 20:05:56 user nova-compute[74429]: </domain>
Oct 23 20:05:56 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81536a66-6e, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81536a66-6e, col_values=(('qos', UUID('6c504ba5-a241-4eb6-9a02-786f88782473')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81536a66-6e, col_values=(('external_ids', {'iface-id': '81536a66-6e9d-4fba-82aa-652c7b34e8c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:2d:07', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance destroyed successfully.
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e')
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e665023-e130-5f03-b682-921fa5ebbb2b', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No VIF found with MAC fa:16:3e:e9:c8:13, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap146d960d-25, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap146d960d-25, col_values=(('qos', UUID('25ebb2c2-f5af-4e75-be2f-a923aa506b60')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap146d960d-25, col_values=(('external_ids', {'iface-id': '146d960d-25ab-46b0-b5ff-597a50999436', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:8c:08', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25')
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ff1945b-babd-531d-99dd-a1bc453c74f8', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a880b39-b1, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a880b39-b1, col_values=(('qos', UUID('e662533d-04fb-412e-90aa-8bdc87d84464')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a880b39-b1, col_values=(('external_ids', {'iface-id': '0a880b39-b14a-486d-802b-315e5802de34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:c6:f4', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1')
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba05dffd-1ca2-53c0-aed2-9a9f21f51c60', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb482176d-b4, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb482176d-b4, col_values=(('qos', UUID('7a153086-9ec8-4a20-8a0c-0fd8c872c34e')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb482176d-b4, col_values=(('external_ids', {'iface-id': 'b482176d-b452-4813-ad77-1ee2dc570b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:ee:96', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4')
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5154ba85-67db-5e10-8024-f8d4ebe3dc9d', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6481d5aa-66, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6481d5aa-66, col_values=(('qos', UUID('b3e3a887-0ddf-4177-b712-822c3eb3d930')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6481d5aa-66, col_values=(('external_ids', {'iface-id': '6481d5aa-66b4-4ab0-a0af-78c41dacef13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:86:93', 'vm-uuid': '53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: INFO os_vif [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66')
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] No BDM found with device name hda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] No VIF found with MAC fa:16:3e:4a:80:30, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] No VIF found with MAC fa:16:3e:cd:c6:f4, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:05:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Using config drive
Oct 23 20:05:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-1c4f053b-0c4e-463d-9b4e-38ec59d8cc3d req-567dabf9-6a16-4cab-a43b-93c7a94baa01 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1c4f053b-0c4e-463d-9b4e-38ec59d8cc3d req-567dabf9-6a16-4cab-a43b-93c7a94baa01 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1c4f053b-0c4e-463d-9b4e-38ec59d8cc3d req-567dabf9-6a16-4cab-a43b-93c7a94baa01 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1c4f053b-0c4e-463d-9b4e-38ec59d8cc3d req-567dabf9-6a16-4cab-a43b-93c7a94baa01 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:05:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-1c4f053b-0c4e-463d-9b4e-38ec59d8cc3d req-567dabf9-6a16-4cab-a43b-93c7a94baa01 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:05:57 user nova-compute[74429]: WARNING nova.compute.manager [req-1c4f053b-0c4e-463d-9b4e-38ec59d8cc3d req-567dabf9-6a16-4cab-a43b-93c7a94baa01 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state building and task_state spawning.
Oct 23 20:05:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Creating config drive at /opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc/disk.config
Oct 23 20:05:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjfny4i0x {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:05:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjfny4i0x" returned: 0 in 0.062s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:05:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:05:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-2ef767af-643d-405c-9f99-11d4b720d754 req-5a1a9c1e-2495-494b-815f-3d2193f50f85 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2ef767af-643d-405c-9f99-11d4b720d754 req-5a1a9c1e-2495-494b-815f-3d2193f50f85 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2ef767af-643d-405c-9f99-11d4b720d754 req-5a1a9c1e-2495-494b-815f-3d2193f50f85 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2ef767af-643d-405c-9f99-11d4b720d754 req-5a1a9c1e-2495-494b-815f-3d2193f50f85 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-2ef767af-643d-405c-9f99-11d4b720d754 req-5a1a9c1e-2495-494b-815f-3d2193f50f85 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:00 user nova-compute[74429]: WARNING nova.compute.manager [req-2ef767af-643d-405c-9f99-11d4b720d754 req-5a1a9c1e-2495-494b-815f-3d2193f50f85 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state building and task_state spawning.
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-69cefbab-577d-4387-b516-6a3f01a114ad req-0f94c8cf-9e1b-4860-93a9-43b22c0121df service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-69cefbab-577d-4387-b516-6a3f01a114ad req-0f94c8cf-9e1b-4860-93a9-43b22c0121df service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-69cefbab-577d-4387-b516-6a3f01a114ad req-0f94c8cf-9e1b-4860-93a9-43b22c0121df service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-69cefbab-577d-4387-b516-6a3f01a114ad req-0f94c8cf-9e1b-4860-93a9-43b22c0121df service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-69cefbab-577d-4387-b516-6a3f01a114ad req-0f94c8cf-9e1b-4860-93a9-43b22c0121df service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:01 user nova-compute[74429]: WARNING nova.compute.manager [req-69cefbab-577d-4387-b516-6a3f01a114ad req-0f94c8cf-9e1b-4860-93a9-43b22c0121df service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state active and task_state rescuing.
Oct 23 20:06:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-1fe9e65c-2b0b-4df7-aa43-e222e3875709 req-a1358791-758f-4b0b-b8b1-1e2b689eb4b8 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1fe9e65c-2b0b-4df7-aa43-e222e3875709 req-a1358791-758f-4b0b-b8b1-1e2b689eb4b8 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1fe9e65c-2b0b-4df7-aa43-e222e3875709 req-a1358791-758f-4b0b-b8b1-1e2b689eb4b8 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1fe9e65c-2b0b-4df7-aa43-e222e3875709 req-a1358791-758f-4b0b-b8b1-1e2b689eb4b8 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-1fe9e65c-2b0b-4df7-aa43-e222e3875709 req-a1358791-758f-4b0b-b8b1-1e2b689eb4b8 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:01 user nova-compute[74429]: WARNING nova.compute.manager [req-1fe9e65c-2b0b-4df7-aa43-e222e3875709 req-a1358791-758f-4b0b-b8b1-1e2b689eb4b8 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 for instance with vm_state building and task_state spawning.
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance spawned successfully.
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-1d8045b5-8fa0-49d2-8f78-ae7bef7ae309 req-71f92425-5e91-4218-b17d-c4a9e0d407bb service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1d8045b5-8fa0-49d2-8f78-ae7bef7ae309 req-71f92425-5e91-4218-b17d-c4a9e0d407bb service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1d8045b5-8fa0-49d2-8f78-ae7bef7ae309 req-71f92425-5e91-4218-b17d-c4a9e0d407bb service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1d8045b5-8fa0-49d2-8f78-ae7bef7ae309 req-71f92425-5e91-4218-b17d-c4a9e0d407bb service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-1d8045b5-8fa0-49d2-8f78-ae7bef7ae309 req-71f92425-5e91-4218-b17d-c4a9e0d407bb service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:02 user nova-compute[74429]: WARNING nova.compute.manager [req-1d8045b5-8fa0-49d2-8f78-ae7bef7ae309 req-71f92425-5e91-4218-b17d-c4a9e0d407bb service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 for instance with vm_state building and task_state spawning.
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: INFO nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Took 11.03 seconds to spawn the instance on the hypervisor.
Oct 23 20:06:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:06:02 user nova-compute[74429]: INFO nova.compute.manager [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Took 12.33 seconds to build instance.
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3d31fa8b-e7e2-4168-9133-1fee92300648 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.522s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-276821b7-f6fb-41d0-96ae-d20d134ce80d req-3f2636a2-6e6a-422b-8faa-9b85535effb5 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-276821b7-f6fb-41d0-96ae-d20d134ce80d req-3f2636a2-6e6a-422b-8faa-9b85535effb5 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-276821b7-f6fb-41d0-96ae-d20d134ce80d req-3f2636a2-6e6a-422b-8faa-9b85535effb5 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-276821b7-f6fb-41d0-96ae-d20d134ce80d req-3f2636a2-6e6a-422b-8faa-9b85535effb5 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-276821b7-f6fb-41d0-96ae-d20d134ce80d req-3f2636a2-6e6a-422b-8faa-9b85535effb5 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:03 user nova-compute[74429]: WARNING nova.compute.manager [req-276821b7-f6fb-41d0-96ae-d20d134ce80d req-3f2636a2-6e6a-422b-8faa-9b85535effb5 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 for instance with vm_state building and task_state spawning.
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:03 user nova-compute[74429]: WARNING nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state active and task_state rescuing.
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:03 user nova-compute[74429]: WARNING nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with vm_state building and task_state spawning.
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:03 user nova-compute[74429]: WARNING nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with vm_state building and task_state spawning.
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:03 user nova-compute[74429]: WARNING nova.compute.manager [req-c69d23a3-0096-40fe-8241-5114e213e668 req-22e0fc20-79ef-464b-ada7-f031aa0d7e77 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 for instance with vm_state building and task_state spawning.
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:04 user nova-compute[74429]: WARNING nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 for instance with vm_state building and task_state spawning.
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:04 user nova-compute[74429]: WARNING nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 for instance with vm_state building and task_state spawning.
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:04 user nova-compute[74429]: WARNING nova.compute.manager [req-8d77f89f-2af0-4815-b2f0-078393f3a2f7 req-b6392b36-3060-4fe2-a48a-476cc8ce7eb4 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 for instance with vm_state building and task_state spawning.
Oct 23 20:06:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8e10b5b5-8c4d-4e0e-ba4d-eadafd69b304 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:05 user nova-compute[74429]: WARNING nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d for instance with vm_state building and task_state spawning.
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:05 user nova-compute[74429]: WARNING nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d for instance with vm_state building and task_state spawning.
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:05 user nova-compute[74429]: WARNING nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 for instance with vm_state building and task_state spawning.
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:05 user nova-compute[74429]: WARNING nova.compute.manager [req-9c2ef07a-cff4-4602-80d2-5b001015dbd5 req-5f7e2c99-d953-4fee-bec7-80d35b567b45 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 for instance with vm_state building and task_state spawning.
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-d04d2138-3b45-4365-a40a-b71f709dda1c req-4789df17-b325-4314-92dd-65ace5648f02 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d04d2138-3b45-4365-a40a-b71f709dda1c req-4789df17-b325-4314-92dd-65ace5648f02 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d04d2138-3b45-4365-a40a-b71f709dda1c req-4789df17-b325-4314-92dd-65ace5648f02 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d04d2138-3b45-4365-a40a-b71f709dda1c req-4789df17-b325-4314-92dd-65ace5648f02 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-d04d2138-3b45-4365-a40a-b71f709dda1c req-4789df17-b325-4314-92dd-65ace5648f02 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:05 user nova-compute[74429]: WARNING nova.compute.manager [req-d04d2138-3b45-4365-a40a-b71f709dda1c req-4789df17-b325-4314-92dd-65ace5648f02 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 for instance with vm_state building and task_state spawning.
Oct 23 20:06:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:06:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance spawned successfully.
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:06:06 user nova-compute[74429]: INFO nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Took 16.27 seconds to spawn the instance on the hypervisor.
Oct 23 20:06:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:06:06 user nova-compute[74429]: INFO nova.compute.manager [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Took 111.12 seconds to build instance.
Oct 23 20:06:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff8e83d6-2f3d-4e01-8a90-f722fed2f3a1 tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 111.257s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 44.684s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:06 user nova-compute[74429]: INFO nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 23 20:06:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-changed-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Refreshing instance network info cache due to event network-changed-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] Acquiring lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] Acquired lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Refreshing network info cache for port 588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:06:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updated VIF entry in instance network info cache for port 588bcb4d-f13f-4c62-ab1f-e8e7b970f95f. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:06:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updating instance_info_cache with network_info: [{"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:06:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-86c3b798-1bd8-4c13-bd70-d5b534cc3063 req-3289dcd4-6e2c-428a-b596-6461f420b929 service nova] Releasing lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:06:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:14 user nova-compute[74429]: INFO nova.compute.manager [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Detaching volume 12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:06:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:14 user nova-compute[74429]: INFO nova.virt.block_device [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Attempting to driver detach volume 12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd from mountpoint /dev/vdb
Oct 23 20:06:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Attempting to detach device vdb from instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:06:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:06:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:06:14 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:06:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:06:14 user nova-compute[74429]:   <serial>12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd</serial>
Oct 23 20:06:14 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:06:14 user nova-compute[74429]: </disk>
Oct 23 20:06:14 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:06:14 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Successfully detached device vdb from instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b from the persistent domain config.
Oct 23 20:06:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:06:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:06:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:06:14 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:06:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:06:14 user nova-compute[74429]:   <serial>12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd</serial>
Oct 23 20:06:14 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:06:14 user nova-compute[74429]: </disk>
Oct 23 20:06:14 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:06:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.504s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:06:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG nova.objects.instance [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'flavor' on Instance uuid b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:20 user nova-compute[74429]: INFO nova.compute.manager [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Attaching volume 4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 to /dev/vdb
Oct 23 20:06:20 user nova-compute[74429]: DEBUG os_brick.utils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7211dba0-1299-4824-8def-a5c2a42bf99f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[95560355-32e6-4451-9ba1-9172f96b91b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b076cac-2fa3-47eb-bbaf-2842b2b17ca0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:21 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:06:21 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.26742172241211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d723a68-a222-4ff9-876a-b682a9ff06ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:06:21 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf7640e-fdb7-435f-b7cb-f61ec8061593]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG os_brick.utils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] <== get_connector_properties: return (658ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updating existing volume attachment record: dc451422-f080-47a3-ae77-f343a892501d {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Applying migration context for instance 44034c15-e9c6-466b-959a-534b818bab5c as it has an incoming, in-progress migration e679dfeb-0806-4495-b18d-dc1374152eb7. Migration status is finished {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 20:06:21 user nova-compute[74429]: INFO nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating resource usage from migration e679dfeb-0806-4495-b18d-dc1374152eb7
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b02494e7-5fd0-4a23-ae27-252fdea795c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Migration e679dfeb-0806-4495-b18d-dc1374152eb7 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:06:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:06:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:06:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:06:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:06:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:06:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-changed-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Refreshing instance network info cache due to event network-changed-f2a7aa16-4b78-440a-a815-9865852163a7. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Refreshing network info cache for port f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:06:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updated VIF entry in instance network info cache for port f2a7aa16-4b78-440a-a815-9865852163a7. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:06:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:06:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d18842e3-813f-4da1-af98-38b9a4be641c req-835098b3-6519-470a-8927-39c8ba9f3acf service nova] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:06:35 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b is timed out.
Oct 23 20:06:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Successfully detached device vdb from instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b from the live domain config.
Oct 23 20:06:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mzESxjRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:06:35 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a9e61d-be9f-48cb-b4fc-3222f0456d7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:06:35 user nova-compute[74429]: No targets found.
Oct 23 20:06:35 user nova-compute[74429]: iSNS:
Oct 23 20:06:35 user nova-compute[74429]: No targets found.
Oct 23 20:06:35 user nova-compute[74429]: STATIC:
Oct 23 20:06:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd
Oct 23 20:06:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573
Oct 23 20:06:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:06:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf
Oct 23 20:06:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc
Oct 23 20:06:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:06:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:35 user nova-compute[74429]: FIRMWARE:
Oct 23 20:06:35 user nova-compute[74429]: No targets found.
Oct 23 20:06:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:06:35 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:06:35 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd65f3-56f7-4216-9e16-97b3048a7faf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b1f7c-e869-4122-ba6e-dfeb7ce0530b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:35 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d59352170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[94da82b7-3471-4020-a452-292b65628e1a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae0bfd8-9833-4a78-bbd4-9261bacb06c3]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9abf8e-d3ed-4500-a874-2568e8aa4557]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c195f9-8dbb-42ab-a227-7fc88211d2ec]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[08876c13-deaf-4a7e-9d73-2a0adf5d255e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13da4e4-ab8e-4751-9e3c-0fd33f37d715]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260]
Oct 23 20:06:35 user nova-compute[74429]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd, portal: 172.16.0.220,3260] successful.
Oct 23 20:06:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12cbe4bb-367d-4ab6-a5ae-1de607fb0cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82264e16-086d-4aeb-9eca-5330e0501a1e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] <== disconnect_volume: return (350ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:06:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:06:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:42 user nova-compute[74429]: DEBUG nova.objects.instance [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'flavor' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:06:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-167200ac-67de-4c0e-9d58-fcea8acbafa1 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.341s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Port a6a5270f-79da-4735-a1f4-5bc0fac5259d binding to destination host user is already ACTIVE {{(pid=74429) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 20:06:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:06:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:06:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Creating tmpfile /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/tmpqboh53yp to verify with other compute node that the instance is on the same shared storage. {{(pid=74429) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-dc6e0af6-76a5-4053-a826-358af528436b req-604ed79a-4f90-4bd7-b712-2ac42a681e08 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dc6e0af6-76a5-4053-a826-358af528436b req-604ed79a-4f90-4bd7-b712-2ac42a681e08 service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dc6e0af6-76a5-4053-a826-358af528436b req-604ed79a-4f90-4bd7-b712-2ac42a681e08 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dc6e0af6-76a5-4053-a826-358af528436b req-604ed79a-4f90-4bd7-b712-2ac42a681e08 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-dc6e0af6-76a5-4053-a826-358af528436b req-604ed79a-4f90-4bd7-b712-2ac42a681e08 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:47 user nova-compute[74429]: WARNING nova.compute.manager [req-dc6e0af6-76a5-4053-a826-358af528436b req-604ed79a-4f90-4bd7-b712-2ac42a681e08 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state resized and task_state resize_reverting.
Oct 23 20:06:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance destroyed successfully.
Oct 23 20:06:48 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'resources' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6a5270f-79, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNDSTJQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:06:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:06:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:06:48 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42b4e2b6-c7a1-4953-b13d-2de3ebe6391d) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:48 user nova-compute[74429]: INFO os_vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79')
Oct 23 20:06:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:06:48 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db99c24-3d94-4b7e-992a-2291125f3f1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:06:48 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40af432-9105-419c-9a9a-5f9d02aa4f8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82] added
Oct 23 20:06:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46af958-cdbf-4b11-abb1-1a69f1c62bf7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5c4bf3-3847-4707-84c9-ad671f4eef8b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNDSTJQL {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNDSTJQL" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d75cbd3-ca12-4c38-9eeb-be10ea709058]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNDSTJQL'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc3849-690f-44ef-8aba-0eebd1b40ad0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced31aa-5f9d-4e3c-8c1f-486cce47c5a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[53607127-595a-424e-87b8-9e04c742f1d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260]
Oct 23 20:06:48 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260] successful.
Oct 23 20:06:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7184c341-bfc6-4454-918f-5afb82c051f7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6752df-0e1f-4783-ad9a-2ba61c6c9178]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:48 user nova-compute[74429]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)
Oct 23 20:06:48 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c03f988-b521-4b78-8bc4-df935e94e421]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:06:48 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNDSTJQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26131626136373132', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131626136373132', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.347s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG nova.objects.instance [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'flavor' on Instance uuid b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db5978-2f61-4f1c-992e-0034501c7c40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:06:49 user nova-compute[74429]: No targets found.
Oct 23 20:06:49 user nova-compute[74429]: iSNS:
Oct 23 20:06:49 user nova-compute[74429]: No targets found.
Oct 23 20:06:49 user nova-compute[74429]: STATIC:
Oct 23 20:06:49 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573
Oct 23 20:06:49 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:49 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:49 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82
Oct 23 20:06:49 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:49 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:49 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:06:49 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:49 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:49 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf
Oct 23 20:06:49 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:49 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:49 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc
Oct 23 20:06:49 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:49 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:49 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:06:49 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:06:49 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:06:49 user nova-compute[74429]: FIRMWARE:
Oct 23 20:06:49 user nova-compute[74429]: No targets found.
Oct 23 20:06:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:06:49 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:06:49 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:06:49 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:06:49 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:06:49 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:06:49 user nova-compute[74429]:   <serial>4dbc208e-1c34-4bc6-99a6-3f2e53cdec82</serial>
Oct 23 20:06:49 user nova-compute[74429]: </disk>
Oct 23 20:06:49 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e208d-5d7a-4ae5-bfa7-036e3c60917c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0a813d-baba-47f3-b4d8-8ddde2760826]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:06:49 user nova-compute[74429]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)
Oct 23 20:06:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c7b7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3dc85a-c873-43c0-8d81-b471586bc423]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4415ba-7bf7-4923-a13d-119d589efeef]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1797df-6865-4847-9c8d-41af41238309]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-6f870948-f027-4ce0-be0a-590b18cc2b15 req-72c9288d-9b56-4b52-8cee-f1b446bed5c1 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6f870948-f027-4ce0-be0a-590b18cc2b15 req-72c9288d-9b56-4b52-8cee-f1b446bed5c1 service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6f870948-f027-4ce0-be0a-590b18cc2b15 req-72c9288d-9b56-4b52-8cee-f1b446bed5c1 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6f870948-f027-4ce0-be0a-590b18cc2b15 req-72c9288d-9b56-4b52-8cee-f1b446bed5c1 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-6f870948-f027-4ce0-be0a-590b18cc2b15 req-72c9288d-9b56-4b52-8cee-f1b446bed5c1 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:06:49 user nova-compute[74429]: WARNING nova.compute.manager [req-6f870948-f027-4ce0-be0a-590b18cc2b15 req-72c9288d-9b56-4b52-8cee-f1b446bed5c1 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state resized and task_state resize_reverting.
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62dc3eb-7368-4649-bec0-3f36bd009305]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d730d2d-a474-41fb-becd-e45da3e536ff]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ef643-3f33-4537-9684-190724e224c5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]
Oct 23 20:06:49 user nova-compute[74429]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.
Oct 23 20:06:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef4b037-98d3-47fd-aeee-59139fc52ea3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== disconnect_volume: return (1682ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:06:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:06:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:06:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:06:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No VIF found with MAC fa:16:3e:c1:b2:41, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:06:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-071312cc-5e0b-49cb-8d74-7225afc90f98 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.691s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:51 user nova-compute[74429]: INFO nova.compute.manager [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Detaching volume 4dbc208e-1c34-4bc6-99a6-3f2e53cdec82
Oct 23 20:06:51 user nova-compute[74429]: INFO nova.virt.block_device [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Attempting to driver detach volume 4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 from mountpoint /dev/vdb
Oct 23 20:06:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Attempting to detach device vdb from instance b02494e7-5fd0-4a23-ae27-252fdea795c9 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:06:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:06:51 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:06:51 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:06:51 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:06:51 user nova-compute[74429]:   <serial>4dbc208e-1c34-4bc6-99a6-3f2e53cdec82</serial>
Oct 23 20:06:51 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:06:51 user nova-compute[74429]: </disk>
Oct 23 20:06:51 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:06:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Successfully detached device vdb from instance b02494e7-5fd0-4a23-ae27-252fdea795c9 from the persistent domain config.
Oct 23 20:06:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b02494e7-5fd0-4a23-ae27-252fdea795c9 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:06:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:06:51 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:06:51 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:06:51 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:06:51 user nova-compute[74429]:   <serial>4dbc208e-1c34-4bc6-99a6-3f2e53cdec82</serial>
Oct 23 20:06:51 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:06:51 user nova-compute[74429]: </disk>
Oct 23 20:06:51 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:06:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:06:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:06:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'migration_context' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG nova.objects.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Object Instance<44034c15-e9c6-466b-959a-534b818bab5c> lazy-loaded attributes: resources,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.456s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:06:59 user nova-compute[74429]: INFO nova.compute.manager [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Swapping old allocation on dict_keys(['a94720e8-5668-448c-953f-7356c8921b17']) held by migration e679dfeb-0806-4495-b18d-dc1374152eb7 for instance
Oct 23 20:06:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Overwriting current allocation {'allocations': {'a94720e8-5668-448c-953f-7356c8921b17': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 20}}, 'project_id': 'f07fe256e3f84a4594ecccfc011aeea3', 'user_id': '9dc4633f95ff40f4a2859c6673112f94', 'consumer_generation': 1} on consumer 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquired lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:06:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Releasing lock "refresh_cache-44034c15-e9c6-466b-959a-534b818bab5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG os_brick.utils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e461020-5655-42e7-93e0-4718c3c7975d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[792ddd41-ef57-4cb8-8aec-bc982690bad1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71587fe-b408-4c79-a77a-6a9fa5d84b40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a48929-c6e7-4f65-8a4b-fce94f293e2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:07:00 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:07:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3962b2-a1cf-4264-94e5-af94533930f4]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:07:00 user nova-compute[74429]: DEBUG os_brick.utils [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:05 user nova-compute[74429]: INFO nova.compute.manager [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Terminating instance
Oct 23 20:07:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-b2101153-bfe5-4dd5-915b-53c1ea58941c req-9661c954-54be-4074-9711-4ccc80122493 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b2101153-bfe5-4dd5-915b-53c1ea58941c req-9661c954-54be-4074-9711-4ccc80122493 service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b2101153-bfe5-4dd5-915b-53c1ea58941c req-9661c954-54be-4074-9711-4ccc80122493 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b2101153-bfe5-4dd5-915b-53c1ea58941c req-9661c954-54be-4074-9711-4ccc80122493 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-b2101153-bfe5-4dd5-915b-53c1ea58941c req-9661c954-54be-4074-9711-4ccc80122493 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-b2101153-bfe5-4dd5-915b-53c1ea58941c req-9661c954-54be-4074-9711-4ccc80122493 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-unplugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Instance destroyed successfully.
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lazy-loading 'resources' on Instance uuid a6709080-2cd7-4ee9-9d6e-7390fc5ae21b {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1699081527',display_name='tempest-ServerStableDeviceRescueTest-server-1699081527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1699081527',id=4,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2Jg3pnZIV6KdiWvNFbrI5BCvfS0w00IzRsIvTJ4VWI8DWNqRo5u9/MJx5Tsxja1iY+qnFhS+w3Qdtu3A4TDZnJ8qQfBHriSrG4xi723no/XkjimGWh+8PWeK/2SgP3Ww==',key_name='tempest-keypair-874344455',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3f0451253f94380b18335a46be24fa1',ramdisk_id='',reservation_id='r-qbloz6l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1612166300',owner_user_name='tempest-ServerStableDeviceRescueTest-1612166300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88700b7acce44892b2cb4fe00e1a25df',uuid=a6709080-2cd7-4ee9-9d6e-7390fc5ae21b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converting VIF {"id": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "address": "fa:16:3e:00:37:0d", "network": {"id": "e749b786-fad8-407b-98a3-c55cc41a0399", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-270189387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3f0451253f94380b18335a46be24fa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3359d2-10", "ovs_interfaceid": "2d3359d2-106a-4f09-a6e7-d5cafc924c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG os_vif [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d3359d2-10, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfa98996-7d56-4c4b-955c-73f8e8068519) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:06 user nova-compute[74429]: INFO os_vif [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:37:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d3359d2-106a-4f09-a6e7-d5cafc924c2b,network=Network(e749b786-fad8-407b-98a3-c55cc41a0399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3359d2-10')
Oct 23 20:07:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Deleting instance files /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b_del
Oct 23 20:07:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Deletion of /opt/stack/data/nova/instances/a6709080-2cd7-4ee9-9d6e-7390fc5ae21b_del complete
Oct 23 20:07:06 user nova-compute[74429]: INFO nova.compute.manager [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 20:07:06 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:07:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:07:07 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:07 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Took 1.08 seconds to deallocate network for instance.
Oct 23 20:07:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:07 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:07:07 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:07:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:07 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Deleted allocations for instance a6709080-2cd7-4ee9-9d6e-7390fc5ae21b
Oct 23 20:07:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] Acquiring lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] No waiting events found dispatching network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:08 user nova-compute[74429]: WARNING nova.compute.manager [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received unexpected event network-vif-plugged-2d3359d2-106a-4f09-a6e7-d5cafc924c2b for instance with vm_state deleted and task_state None.
Oct 23 20:07:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-62f57492-5717-4742-83d7-8ce35389f459 req-e1db6298-e8b5-4203-8fb9-b51c98871541 service nova] [instance: a6709080-2cd7-4ee9-9d6e-7390fc5ae21b] Received event network-vif-deleted-2d3359d2-106a-4f09-a6e7-d5cafc924c2b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-409a585c-9d5d-4a7a-b14e-551815bd6c67 tempest-ServerStableDeviceRescueTest-1612166300 tempest-ServerStableDeviceRescueTest-1612166300-project-member] Lock "a6709080-2cd7-4ee9-9d6e-7390fc5ae21b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.642s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:12 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b02494e7-5fd0-4a23-ae27-252fdea795c9 is timed out.
Oct 23 20:07:12 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Successfully detached device vdb from instance b02494e7-5fd0-4a23-ae27-252fdea795c9 from the live domain config.
Oct 23 20:07:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNDSTJQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f95b60-ae9b-43f5-b07e-cfeb8a5ef49e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:07:12 user nova-compute[74429]: No targets found.
Oct 23 20:07:12 user nova-compute[74429]: iSNS:
Oct 23 20:07:12 user nova-compute[74429]: No targets found.
Oct 23 20:07:12 user nova-compute[74429]: STATIC:
Oct 23 20:07:12 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573
Oct 23 20:07:12 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:12 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:12 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82
Oct 23 20:07:12 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:12 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:12 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:07:12 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:12 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:12 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf
Oct 23 20:07:12 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:12 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:12 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc
Oct 23 20:07:12 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:12 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:12 user nova-compute[74429]: FIRMWARE:
Oct 23 20:07:12 user nova-compute[74429]: No targets found.
Oct 23 20:07:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:07:12 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:07:12 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c771a-8f8a-4d1d-b5a1-9e7690f2fb87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2016f269-be56-4c6d-9556-231fdf146ad0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)
Oct 23 20:07:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:12 user nova-compute[74429]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 (non-flash)
Oct 23 20:07:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50451d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2917185b-96bd-41e7-86da-457044848783]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d115a-abc1-4dd8-8bcc-c528414b188d]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca0fbf-42a5-4158-9edb-935d6b6ee866]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32de78-5d79-45e9-81cb-ee538cf50a96]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deff276-ac00-4694-acf5-76c847580ae2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4443ff-b5f7-43ac-973e-eb0324934c57]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260]
Oct 23 20:07:12 user nova-compute[74429]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82, portal: 172.16.0.220,3260] successful.
Oct 23 20:07:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbc208e-1c34-4bc6-99a6-3f2e53cdec82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4848089-21bd-42f3-8ec5-9ca0210f1ecf]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] <== disconnect_volume: return (346ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:07:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'flavor' on Instance uuid b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a402fd68-b02f-4271-b186-40bc42a2c661 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:16 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating instance_info_cache with network_info: [{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:07:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-changed-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Refreshing instance network info cache due to event network-changed-3692c2a8-df8e-48f8-b286-dcb406283c67. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] Acquiring lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] Acquired lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG nova.network.neutron [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Refreshing network info cache for port 3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG nova.objects.instance [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'flavor' on Instance uuid 2bd6dbca-177e-4289-ac29-c7b114f72d00 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:21 user nova-compute[74429]: INFO nova.compute.manager [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Attaching volume f08fefb8-5075-422e-99e7-6c424fa04085 to /dev/vdb
Oct 23 20:07:21 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:21 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7542MB free_disk=25.343547821044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG os_brick.utils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf6d966-6e66-4f86-a443-a48485d6b5b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updated VIF entry in instance network info cache for port 3692c2a8-df8e-48f8-b286-dcb406283c67. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updating instance_info_cache with network_info: [{"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056f980-218d-49af-a5af-6597c5e134b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8536f2d3-5f46-4574-ba46-3ad573d177f9 req-51b53f9f-a47f-473c-aa1e-5e24134632c7 service nova] Releasing lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1e9110-d0e7-4988-b970-1ff9abf596bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b02494e7-5fd0-4a23-ae27-252fdea795c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[491afa1e-3534-49c3-931b-7fe8751987a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:07:21 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b80de-7968-404e-85ff-b642dd7ce6f5]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG os_brick.utils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updating existing volume attachment record: e9b893c6-2e2f-48fe-8f08-3251ea641669 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:07:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:07:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:24 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:07:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Starting finish_revert_migration {{(pid=74429) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start _get_guest_xml network_info=[{"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '080a2e3f-a55e-462b-bdb6-bf0c8ad820c7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '44034c15-e9c6-466b-959a-534b818bab5c', 'attached_at': '2023-10-23T20:07:29.000000', 'detached_at': '', 'volume_id': 'c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'serial': 'c7ff430d-b88f-48f3-81c0-888a3f5c75d0'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:07:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:29 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:29 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:29 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2296af5d-7404-4ce5-b45e-df35b3ee5fc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:07:29 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce1e95e-87cb-44d1-9012-0889976b1c06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0] added
Oct 23 20:07:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c45e16c-7ad1-43a9-8635-9ee8cfd98052]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da1bae-1e4e-4159-a99e-00107b0b0eed]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Zfxzdcph {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Zfxzdcph" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5486a8ec-95fe-47b0-b4dd-938750f1a651]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Zfxzdcph'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1c214e-9a7f-4618-91c7-87d750bf4a0c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96782b7-d46e-4163-878f-32f943ab8180]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447f13f-8089-4186-8625-de88a1fae0c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]
Oct 23 20:07:29 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.
Oct 23 20:07:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe2c94-4eaf-48d2-bf76-910d3ebc9736]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9fa139-03f3-4493-9049-cc6375b9a3af]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:29 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd5e94-9063-4172-a79e-cd00946e9b19]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:29 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23430333333363239', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430333333363239', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:07:30 user nova-compute[74429]:   <uuid>44034c15-e9c6-466b-959a-534b818bab5c</uuid>
Oct 23 20:07:30 user nova-compute[74429]:   <name>instance-00000003</name>
Oct 23 20:07:30 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:07:30 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:07:30 user nova-compute[74429]:   <metadata>
Oct 23 20:07:30 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:07:30 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:07:30 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherB-server-594920033</nova:name>
Oct 23 20:07:30 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:07:29</nova:creationTime>
Oct 23 20:07:30 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:07:30 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:07:30 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:07:30 user nova-compute[74429]:       <nova:owner>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:user uuid="9dc4633f95ff40f4a2859c6673112f94">tempest-ServerActionsTestOtherB-1184256079-project-member</nova:user>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:project uuid="f07fe256e3f84a4594ecccfc011aeea3">tempest-ServerActionsTestOtherB-1184256079</nova:project>
Oct 23 20:07:30 user nova-compute[74429]:       </nova:owner>
Oct 23 20:07:30 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:07:30 user nova-compute[74429]:       <nova:ports>
Oct 23 20:07:30 user nova-compute[74429]:         <nova:port uuid="a6a5270f-79da-4735-a1f4-5bc0fac5259d">
Oct 23 20:07:30 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 20:07:30 user nova-compute[74429]:         </nova:port>
Oct 23 20:07:30 user nova-compute[74429]:       </nova:ports>
Oct 23 20:07:30 user nova-compute[74429]:     </nova:instance>
Oct 23 20:07:30 user nova-compute[74429]:   </metadata>
Oct 23 20:07:30 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:07:30 user nova-compute[74429]:     <system>
Oct 23 20:07:30 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:07:30 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:07:30 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:07:30 user nova-compute[74429]:       <entry name="serial">44034c15-e9c6-466b-959a-534b818bab5c</entry>
Oct 23 20:07:30 user nova-compute[74429]:       <entry name="uuid">44034c15-e9c6-466b-959a-534b818bab5c</entry>
Oct 23 20:07:30 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:07:30 user nova-compute[74429]:     </system>
Oct 23 20:07:30 user nova-compute[74429]:   </sysinfo>
Oct 23 20:07:30 user nova-compute[74429]:   <os>
Oct 23 20:07:30 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:07:30 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:07:30 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:07:30 user nova-compute[74429]:   </os>
Oct 23 20:07:30 user nova-compute[74429]:   <features>
Oct 23 20:07:30 user nova-compute[74429]:     <acpi/>
Oct 23 20:07:30 user nova-compute[74429]:     <apic/>
Oct 23 20:07:30 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:07:30 user nova-compute[74429]:   </features>
Oct 23 20:07:30 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:07:30 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:07:30 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:07:30 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:07:30 user nova-compute[74429]:   </clock>
Oct 23 20:07:30 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:07:30 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:07:30 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:07:30 user nova-compute[74429]:   </cpu>
Oct 23 20:07:30 user nova-compute[74429]:   <devices>
Oct 23 20:07:30 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:07:30 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:07:30 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk"/>
Oct 23 20:07:30 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:07:30 user nova-compute[74429]:     </disk>
Oct 23 20:07:30 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:07:30 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:07:30 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:07:30 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:07:30 user nova-compute[74429]:       <serial>c7ff430d-b88f-48f3-81c0-888a3f5c75d0</serial>
Oct 23 20:07:30 user nova-compute[74429]:     </disk>
Oct 23 20:07:30 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:07:30 user nova-compute[74429]:       <mac address="fa:16:3e:7f:dd:c6"/>
Oct 23 20:07:30 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:30 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:07:30 user nova-compute[74429]:       <target dev="tapa6a5270f-79"/>
Oct 23 20:07:30 user nova-compute[74429]:     </interface>
Oct 23 20:07:30 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:07:30 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/console.log" append="off"/>
Oct 23 20:07:30 user nova-compute[74429]:     </serial>
Oct 23 20:07:30 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:07:30 user nova-compute[74429]:     <video>
Oct 23 20:07:30 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:30 user nova-compute[74429]:     </video>
Oct 23 20:07:30 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:07:30 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:07:30 user nova-compute[74429]:     </rng>
Oct 23 20:07:30 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:07:30 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:07:30 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:07:30 user nova-compute[74429]:     </memballoon>
Oct 23 20:07:30 user nova-compute[74429]:   </devices>
Oct 23 20:07:30 user nova-compute[74429]: </domain>
Oct 23 20:07:30 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG os_vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a222e76b-f9d5-5518-8b11-6361cb36abf8', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6a5270f-79, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6a5270f-79, col_values=(('qos', UUID('66d5175a-e9f1-4bf2-aa0c-b657e9017cb5')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6a5270f-79, col_values=(('external_ids', {'iface-id': 'a6a5270f-79da-4735-a1f4-5bc0fac5259d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:dd:c6', 'vm-uuid': '44034c15-e9c6-466b-959a-534b818bab5c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:30 user nova-compute[74429]: INFO os_vif [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79')
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-10c783d2-a8e6-4a97-941f-21e85b11a971 req-72665639-d2e1-4db4-b0f0-e6cd9bde0ef3 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-10c783d2-a8e6-4a97-941f-21e85b11a971 req-72665639-d2e1-4db4-b0f0-e6cd9bde0ef3 service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-10c783d2-a8e6-4a97-941f-21e85b11a971 req-72665639-d2e1-4db4-b0f0-e6cd9bde0ef3 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-10c783d2-a8e6-4a97-941f-21e85b11a971 req-72665639-d2e1-4db4-b0f0-e6cd9bde0ef3 service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-10c783d2-a8e6-4a97-941f-21e85b11a971 req-72665639-d2e1-4db4-b0f0-e6cd9bde0ef3 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:32 user nova-compute[74429]: WARNING nova.compute.manager [req-10c783d2-a8e6-4a97-941f-21e85b11a971 req-72665639-d2e1-4db4-b0f0-e6cd9bde0ef3 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state resized and task_state resize_reverting.
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:07:34 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance running successfully.
Oct 23 20:07:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] finish_revert_migration finished successfully. {{(pid=74429) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 23 20:07:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-dfc70278-a034-4b66-b78e-348e4add5544 req-17860b9d-224c-4f9d-a8fb-6442d4a914aa service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dfc70278-a034-4b66-b78e-348e4add5544 req-17860b9d-224c-4f9d-a8fb-6442d4a914aa service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dfc70278-a034-4b66-b78e-348e4add5544 req-17860b9d-224c-4f9d-a8fb-6442d4a914aa service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dfc70278-a034-4b66-b78e-348e4add5544 req-17860b9d-224c-4f9d-a8fb-6442d4a914aa service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-dfc70278-a034-4b66-b78e-348e4add5544 req-17860b9d-224c-4f9d-a8fb-6442d4a914aa service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:34 user nova-compute[74429]: WARNING nova.compute.manager [req-dfc70278-a034-4b66-b78e-348e4add5544 req-17860b9d-224c-4f9d-a8fb-6442d4a914aa service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state resized and task_state resize_reverting.
Oct 23 20:07:34 user nova-compute[74429]: INFO nova.compute.manager [None req-a16fdcb7-444a-4cab-9923-8eca87b8b793 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance to original state: 'active'
Oct 23 20:07:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:07:37 user nova-compute[74429]: INFO nova.compute.claims [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Claim successful on node user
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:07:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:07:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:07:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG nova.policy [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80ac3c2700c2447993ba5a8e14db0aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8768b24d954f5cbb03c242e6a3a1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:07:38 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Creating image(s)
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.261s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.326s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk 1073741824" returned: 0 in 0.129s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.463s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Successfully created port: 7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.291s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Cannot resize image /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Ensure instance console log exists: /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Successfully updated port: 7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquired lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-changed-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Refreshing instance network info cache due to event network-changed-7e1f1772-e866-4eda-a7aa-d62a94d9f560. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] Acquiring lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updating instance_info_cache with network_info: [{"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Releasing lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance network_info: |[{"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] Acquired lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.neutron [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Refreshing network info cache for port 7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Start _get_guest_xml network_info=[{"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:07:40 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:40 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-827890034',display_name='tempest-tempest.common.compute-instance-827890034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-827890034',id=17,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EFIfEvl7T4zhPHVD8bG3YLP7Y2gtAz3vSzwgQmnyjokuMyCUhiDI+u0wB4PLqk+yw5AVHydn/wQ8s3JL0iPGqdCzitvGgcY3aPaoJMI2kBK+hU+fei46Dz8tzhSrFQg==',key_name='tempest-keypair-1147496445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-lw0j6wag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=b3df83c8-d19c-4eee-b1be-80a2ce516d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.objects.instance [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'pci_devices' on Instance uuid b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:07:40 user nova-compute[74429]:   <uuid>b3df83c8-d19c-4eee-b1be-80a2ce516d5c</uuid>
Oct 23 20:07:40 user nova-compute[74429]:   <name>instance-00000011</name>
Oct 23 20:07:40 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:07:40 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:07:40 user nova-compute[74429]:   <metadata>
Oct 23 20:07:40 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:07:40 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:07:40 user nova-compute[74429]:       <nova:name>tempest-tempest.common.compute-instance-827890034</nova:name>
Oct 23 20:07:40 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:07:40</nova:creationTime>
Oct 23 20:07:40 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:07:40 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:07:40 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:07:40 user nova-compute[74429]:       <nova:owner>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:user uuid="80ac3c2700c2447993ba5a8e14db0aa5">tempest-ServerActionsTestOtherA-1925715908-project-member</nova:user>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:project uuid="3f8768b24d954f5cbb03c242e6a3a1f1">tempest-ServerActionsTestOtherA-1925715908</nova:project>
Oct 23 20:07:40 user nova-compute[74429]:       </nova:owner>
Oct 23 20:07:40 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:07:40 user nova-compute[74429]:       <nova:ports>
Oct 23 20:07:40 user nova-compute[74429]:         <nova:port uuid="7e1f1772-e866-4eda-a7aa-d62a94d9f560">
Oct 23 20:07:40 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 20:07:40 user nova-compute[74429]:         </nova:port>
Oct 23 20:07:40 user nova-compute[74429]:       </nova:ports>
Oct 23 20:07:40 user nova-compute[74429]:     </nova:instance>
Oct 23 20:07:40 user nova-compute[74429]:   </metadata>
Oct 23 20:07:40 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:07:40 user nova-compute[74429]:     <system>
Oct 23 20:07:40 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:07:40 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:07:40 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:07:40 user nova-compute[74429]:       <entry name="serial">b3df83c8-d19c-4eee-b1be-80a2ce516d5c</entry>
Oct 23 20:07:40 user nova-compute[74429]:       <entry name="uuid">b3df83c8-d19c-4eee-b1be-80a2ce516d5c</entry>
Oct 23 20:07:40 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:07:40 user nova-compute[74429]:     </system>
Oct 23 20:07:40 user nova-compute[74429]:   </sysinfo>
Oct 23 20:07:40 user nova-compute[74429]:   <os>
Oct 23 20:07:40 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:07:40 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:07:40 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:07:40 user nova-compute[74429]:   </os>
Oct 23 20:07:40 user nova-compute[74429]:   <features>
Oct 23 20:07:40 user nova-compute[74429]:     <acpi/>
Oct 23 20:07:40 user nova-compute[74429]:     <apic/>
Oct 23 20:07:40 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:07:40 user nova-compute[74429]:   </features>
Oct 23 20:07:40 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:07:40 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:07:40 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:07:40 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:07:40 user nova-compute[74429]:   </clock>
Oct 23 20:07:40 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:07:40 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:07:40 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:07:40 user nova-compute[74429]:   </cpu>
Oct 23 20:07:40 user nova-compute[74429]:   <devices>
Oct 23 20:07:40 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:07:40 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:07:40 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk"/>
Oct 23 20:07:40 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:07:40 user nova-compute[74429]:     </disk>
Oct 23 20:07:40 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:07:40 user nova-compute[74429]:       <mac address="fa:16:3e:94:2a:28"/>
Oct 23 20:07:40 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:40 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:07:40 user nova-compute[74429]:       <target dev="tap7e1f1772-e8"/>
Oct 23 20:07:40 user nova-compute[74429]:     </interface>
Oct 23 20:07:40 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:07:40 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/console.log" append="off"/>
Oct 23 20:07:40 user nova-compute[74429]:     </serial>
Oct 23 20:07:40 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:07:40 user nova-compute[74429]:     <video>
Oct 23 20:07:40 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:40 user nova-compute[74429]:     </video>
Oct 23 20:07:40 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:07:40 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:07:40 user nova-compute[74429]:     </rng>
Oct 23 20:07:40 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:07:40 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:07:40 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:07:40 user nova-compute[74429]:     </memballoon>
Oct 23 20:07:40 user nova-compute[74429]:   </devices>
Oct 23 20:07:40 user nova-compute[74429]: </domain>
Oct 23 20:07:40 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-827890034',display_name='tempest-tempest.common.compute-instance-827890034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-827890034',id=17,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EFIfEvl7T4zhPHVD8bG3YLP7Y2gtAz3vSzwgQmnyjokuMyCUhiDI+u0wB4PLqk+yw5AVHydn/wQ8s3JL0iPGqdCzitvGgcY3aPaoJMI2kBK+hU+fei46Dz8tzhSrFQg==',key_name='tempest-keypair-1147496445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-lw0j6wag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=b3df83c8-d19c-4eee-b1be-80a2ce516d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG os_vif [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86e8a716-75b1-568d-9802-65a2e1abcfaa', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e1f1772-e8, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e1f1772-e8, col_values=(('qos', UUID('88ae4da1-5831-4847-9661-6547d4610456')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e1f1772-e8, col_values=(('external_ids', {'iface-id': '7e1f1772-e866-4eda-a7aa-d62a94d9f560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:2a:28', 'vm-uuid': 'b3df83c8-d19c-4eee-b1be-80a2ce516d5c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:40 user nova-compute[74429]: INFO os_vif [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8')
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:07:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No VIF found with MAC fa:16:3e:94:2a:28, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-changed-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Refreshing instance network info cache due to event network-changed-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] Acquiring lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] Acquired lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Refreshing network info cache for port d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updated VIF entry in instance network info cache for port 7e1f1772-e866-4eda-a7aa-d62a94d9f560. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updating instance_info_cache with network_info: [{"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da6fb5e6-a91f-4373-a875-881979599f10 req-6a76bbed-144a-4fb1-85bf-05e8ec118282 service nova] Releasing lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG nova.network.neutron [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updated VIF entry in instance network info cache for port d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG nova.network.neutron [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:42 user nova-compute[74429]: INFO nova.compute.manager [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Unrescuing
Oct 23 20:07:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquired lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-babff69b-437d-4616-9073-55f56f9c4936 req-1029e1d3-31fd-4265-a50f-49d2a7fe553d service nova] Releasing lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Releasing lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'flavor' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-8518e880-02e2-4fc0-a322-5d53673c5a9c req-436d59b2-36f7-45ee-9a90-fc29f48092ff service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8518e880-02e2-4fc0-a322-5d53673c5a9c req-436d59b2-36f7-45ee-9a90-fc29f48092ff service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8518e880-02e2-4fc0-a322-5d53673c5a9c req-436d59b2-36f7-45ee-9a90-fc29f48092ff service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8518e880-02e2-4fc0-a322-5d53673c5a9c req-436d59b2-36f7-45ee-9a90-fc29f48092ff service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-8518e880-02e2-4fc0-a322-5d53673c5a9c req-436d59b2-36f7-45ee-9a90-fc29f48092ff service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:43 user nova-compute[74429]: WARNING nova.compute.manager [req-8518e880-02e2-4fc0-a322-5d53673c5a9c req-436d59b2-36f7-45ee-9a90-fc29f48092ff service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:07:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-9eccca9d-6396-4081-bc13-a36e9f11e298 req-cb95e0b0-3596-42de-a448-f04350ca608e service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9eccca9d-6396-4081-bc13-a36e9f11e298 req-cb95e0b0-3596-42de-a448-f04350ca608e service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9eccca9d-6396-4081-bc13-a36e9f11e298 req-cb95e0b0-3596-42de-a448-f04350ca608e service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9eccca9d-6396-4081-bc13-a36e9f11e298 req-cb95e0b0-3596-42de-a448-f04350ca608e service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-9eccca9d-6396-4081-bc13-a36e9f11e298 req-cb95e0b0-3596-42de-a448-f04350ca608e service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:43 user nova-compute[74429]: WARNING nova.compute.manager [req-9eccca9d-6396-4081-bc13-a36e9f11e298 req-cb95e0b0-3596-42de-a448-f04350ca608e service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state building and task_state spawning.
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance destroyed successfully.
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "f835ce97-1139-4849-85a8-df51f4b01627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:07:44 user nova-compute[74429]: INFO nova.compute.claims [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Claim successful on node user
Oct 23 20:07:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klMpdyIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:44 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:44 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:44 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73a86a-4621-4707-ab2e-a05b5e56fc1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:07:44 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90d1e6-c482-4fca-8a09-b2d00ec4216d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085] added
Oct 23 20:07:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe008f1-414b-4fec-8537-2d5d53659237]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b23621a-322e-45d5-9666-16bae29d53b5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klMpdyIJ {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klMpdyIJ" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[90242677-5ad4-41c2-b2fc-7072ff79f23b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'klMpdyIJ'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[86986dd1-9ca5-4c88-979e-3712f8e40693]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dba4f89-be38-4883-880e-6721e59bffec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9165f61b-9e70-4434-9451-ae0c0dc91570]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260]
Oct 23 20:07:44 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260] successful.
Oct 23 20:07:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd6a9f-3b3e-4c6e-bc13-cd74f02ea530]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41bc1bf-63c9-45e2-a7d5-dd724c89af02]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71715ee-c007-49fe-9c12-eff004d60972]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klMpdyIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:07:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:07:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.policy [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7124ed7c57024d3aa751c46d237ecf50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345690fb675e48679dee09c586df74fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:07:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Creating image(s)
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "/opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "/opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "/opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-ffa5b36f-ca89-4fe0-a93f-839132ae60a0 req-9a5439f8-7008-489b-b0ac-4cb0ee3b1da5 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ffa5b36f-ca89-4fe0-a93f-839132ae60a0 req-9a5439f8-7008-489b-b0ac-4cb0ee3b1da5 service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ffa5b36f-ca89-4fe0-a93f-839132ae60a0 req-9a5439f8-7008-489b-b0ac-4cb0ee3b1da5 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ffa5b36f-ca89-4fe0-a93f-839132ae60a0 req-9a5439f8-7008-489b-b0ac-4cb0ee3b1da5 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-ffa5b36f-ca89-4fe0-a93f-839132ae60a0 req-9a5439f8-7008-489b-b0ac-4cb0ee3b1da5 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:45 user nova-compute[74429]: WARNING nova.compute.manager [req-ffa5b36f-ca89-4fe0-a93f-839132ae60a0 req-9a5439f8-7008-489b-b0ac-4cb0ee3b1da5 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-d60d3ae1-e494-4736-ab91-0e10b3478829 req-58e10ae8-bdbc-4f63-a1a3-d4a09e54d4d0 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d60d3ae1-e494-4736-ab91-0e10b3478829 req-58e10ae8-bdbc-4f63-a1a3-d4a09e54d4d0 service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d60d3ae1-e494-4736-ab91-0e10b3478829 req-58e10ae8-bdbc-4f63-a1a3-d4a09e54d4d0 service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d60d3ae1-e494-4736-ab91-0e10b3478829 req-58e10ae8-bdbc-4f63-a1a3-d4a09e54d4d0 service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-d60d3ae1-e494-4736-ab91-0e10b3478829 req-58e10ae8-bdbc-4f63-a1a3-d4a09e54d4d0 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:45 user nova-compute[74429]: WARNING nova.compute.manager [req-d60d3ae1-e494-4736-ab91-0e10b3478829 req-58e10ae8-bdbc-4f63-a1a3-d4a09e54d4d0 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state building and task_state spawning.
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.209s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:07:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance spawned successfully.
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.248s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '23136373134316433', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136373134316433', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk 1073741824" returned: 0 in 0.106s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG nova.objects.instance [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'flavor' on Instance uuid 2bd6dbca-177e-4289-ac29-c7b114f72d00 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:07:46 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:07:46 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:07:46 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:07:46 user nova-compute[74429]:   <serial>f08fefb8-5075-422e-99e7-6c424fa04085</serial>
Oct 23 20:07:46 user nova-compute[74429]: </disk>
Oct 23 20:07:46 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:07:46 user nova-compute[74429]: INFO nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Took 7.81 seconds to spawn the instance on the hypervisor.
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.267s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:46 user nova-compute[74429]: INFO nova.compute.manager [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Took 9.11 seconds to build instance.
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3f5cede6-ae81-4f77-8ab9-38bd87695012 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.258s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Successfully created port: affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Cannot resize image /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Ensure instance console log exists: /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] No VIF found with MAC fa:16:3e:da:12:d3, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:07:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-af1cfe3c-8725-4f2f-874b-5711a1e3bf01 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.502s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:47 user nova-compute[74429]: WARNING nova.compute.manager [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:47 user nova-compute[74429]: WARNING nova.compute.manager [req-ad8294f4-b641-4121-bf45-99501cabb845 req-04479236-ca5e-43aa-83ce-590dbea0fc5c service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Successfully updated port: affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "refresh_cache-f835ce97-1139-4849-85a8-df51f4b01627" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquired lock "refresh_cache-f835ce97-1139-4849-85a8-df51f4b01627" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:07:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-changed-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing instance network info cache due to event network-changed-76a266f2-c5cd-4169-ab6a-ad14e115b3b4. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] Acquiring lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] Acquired lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.network.neutron [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Refreshing network info cache for port 76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Updating instance_info_cache with network_info: [{"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Releasing lock "refresh_cache-f835ce97-1139-4849-85a8-df51f4b01627" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Instance network_info: |[{"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Start _get_guest_xml network_info=[{"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:07:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-877148026',display_name='tempest-VolumesAdminNegativeTest-server-877148026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-877148026',id=18,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='345690fb675e48679dee09c586df74fe',ramdisk_id='',reservation_id='r-tjgpgsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1432262633',owner_user_name='tempest-VolumesAdminNegativeTest-1432262633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:07:45Z,user_data=None,user_id='7124ed7c57024d3aa751c46d237ecf50',uuid=f835ce97-1139-4849-85a8-df51f4b01627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converting VIF {"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'pci_devices' on Instance uuid f835ce97-1139-4849-85a8-df51f4b01627 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:07:48 user nova-compute[74429]:   <uuid>f835ce97-1139-4849-85a8-df51f4b01627</uuid>
Oct 23 20:07:48 user nova-compute[74429]:   <name>instance-00000012</name>
Oct 23 20:07:48 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:07:48 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:07:48 user nova-compute[74429]:   <metadata>
Oct 23 20:07:48 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:07:48 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:07:48 user nova-compute[74429]:       <nova:name>tempest-VolumesAdminNegativeTest-server-877148026</nova:name>
Oct 23 20:07:48 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:07:48</nova:creationTime>
Oct 23 20:07:48 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:07:48 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:07:48 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:07:48 user nova-compute[74429]:       <nova:owner>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:user uuid="7124ed7c57024d3aa751c46d237ecf50">tempest-VolumesAdminNegativeTest-1432262633-project-member</nova:user>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:project uuid="345690fb675e48679dee09c586df74fe">tempest-VolumesAdminNegativeTest-1432262633</nova:project>
Oct 23 20:07:48 user nova-compute[74429]:       </nova:owner>
Oct 23 20:07:48 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:07:48 user nova-compute[74429]:       <nova:ports>
Oct 23 20:07:48 user nova-compute[74429]:         <nova:port uuid="affa2ce9-d72d-44c0-b31d-ad5b93b25cfe">
Oct 23 20:07:48 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:07:48 user nova-compute[74429]:         </nova:port>
Oct 23 20:07:48 user nova-compute[74429]:       </nova:ports>
Oct 23 20:07:48 user nova-compute[74429]:     </nova:instance>
Oct 23 20:07:48 user nova-compute[74429]:   </metadata>
Oct 23 20:07:48 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:07:48 user nova-compute[74429]:     <system>
Oct 23 20:07:48 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:07:48 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:07:48 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:07:48 user nova-compute[74429]:       <entry name="serial">f835ce97-1139-4849-85a8-df51f4b01627</entry>
Oct 23 20:07:48 user nova-compute[74429]:       <entry name="uuid">f835ce97-1139-4849-85a8-df51f4b01627</entry>
Oct 23 20:07:48 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:07:48 user nova-compute[74429]:     </system>
Oct 23 20:07:48 user nova-compute[74429]:   </sysinfo>
Oct 23 20:07:48 user nova-compute[74429]:   <os>
Oct 23 20:07:48 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:07:48 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:07:48 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:07:48 user nova-compute[74429]:   </os>
Oct 23 20:07:48 user nova-compute[74429]:   <features>
Oct 23 20:07:48 user nova-compute[74429]:     <acpi/>
Oct 23 20:07:48 user nova-compute[74429]:     <apic/>
Oct 23 20:07:48 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:07:48 user nova-compute[74429]:   </features>
Oct 23 20:07:48 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:07:48 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:07:48 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:07:48 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:07:48 user nova-compute[74429]:   </clock>
Oct 23 20:07:48 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:07:48 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:07:48 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:07:48 user nova-compute[74429]:   </cpu>
Oct 23 20:07:48 user nova-compute[74429]:   <devices>
Oct 23 20:07:48 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:07:48 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:07:48 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk"/>
Oct 23 20:07:48 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:07:48 user nova-compute[74429]:     </disk>
Oct 23 20:07:48 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:07:48 user nova-compute[74429]:       <mac address="fa:16:3e:62:e3:38"/>
Oct 23 20:07:48 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:48 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:07:48 user nova-compute[74429]:       <target dev="tapaffa2ce9-d7"/>
Oct 23 20:07:48 user nova-compute[74429]:     </interface>
Oct 23 20:07:48 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:07:48 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/console.log" append="off"/>
Oct 23 20:07:48 user nova-compute[74429]:     </serial>
Oct 23 20:07:48 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:07:48 user nova-compute[74429]:     <video>
Oct 23 20:07:48 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:48 user nova-compute[74429]:     </video>
Oct 23 20:07:48 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:07:48 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:07:48 user nova-compute[74429]:     </rng>
Oct 23 20:07:48 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:07:48 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:07:48 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:07:48 user nova-compute[74429]:     </memballoon>
Oct 23 20:07:48 user nova-compute[74429]:   </devices>
Oct 23 20:07:48 user nova-compute[74429]: </domain>
Oct 23 20:07:48 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-877148026',display_name='tempest-VolumesAdminNegativeTest-server-877148026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-877148026',id=18,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='345690fb675e48679dee09c586df74fe',ramdisk_id='',reservation_id='r-tjgpgsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1432262633',owner_user_name='tempest-VolumesAdminNegativeTest-1432262633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:07:45Z,user_data=None,user_id='7124ed7c57024d3aa751c46d237ecf50',uuid=f835ce97-1139-4849-85a8-df51f4b01627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converting VIF {"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG os_vif [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1aa1d112-e390-596f-a042-c1d1cab92a1e', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8f8e573-253e-47e0-bb7a-387579a42f91 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaffa2ce9-d7, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaffa2ce9-d7, col_values=(('qos', UUID('57a11a96-98e7-4b6b-a192-be9d104971b7')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaffa2ce9-d7, col_values=(('external_ids', {'iface-id': 'affa2ce9-d72d-44c0-b31d-ad5b93b25cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:e3:38', 'vm-uuid': 'f835ce97-1139-4849-85a8-df51f4b01627'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:48 user nova-compute[74429]: INFO os_vif [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7')
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:07:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] No VIF found with MAC fa:16:3e:62:e3:38, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updated VIF entry in instance network info cache for port 76a266f2-c5cd-4169-ab6a-ad14e115b3b4. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-79dc438c-a8d4-42ac-89bc-7bcd3b9638c8 req-5cb6a958-a109-453f-ade6-0d0161014188 service nova] Releasing lock "refresh_cache-53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.044s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:49 user nova-compute[74429]: INFO nova.compute.manager [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Detaching volume f08fefb8-5075-422e-99e7-6c424fa04085
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:49 user nova-compute[74429]: INFO nova.virt.block_device [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Attempting to driver detach volume f08fefb8-5075-422e-99e7-6c424fa04085 from mountpoint /dev/vdb
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Attempting to detach device vdb from instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:07:49 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:07:49 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:07:49 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:07:49 user nova-compute[74429]:   <serial>f08fefb8-5075-422e-99e7-6c424fa04085</serial>
Oct 23 20:07:49 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:07:49 user nova-compute[74429]: </disk>
Oct 23 20:07:49 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:07:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully detached device vdb from instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 from the persistent domain config.
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:07:49 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:07:49 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:07:49 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:07:49 user nova-compute[74429]:   <serial>f08fefb8-5075-422e-99e7-6c424fa04085</serial>
Oct 23 20:07:49 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:07:49 user nova-compute[74429]: </disk>
Oct 23 20:07:49 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-changed-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Refreshing instance network info cache due to event network-changed-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] Acquiring lock "refresh_cache-f835ce97-1139-4849-85a8-df51f4b01627" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] Acquired lock "refresh_cache-f835ce97-1139-4849-85a8-df51f4b01627" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Refreshing network info cache for port affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:49 user nova-compute[74429]: INFO nova.compute.manager [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Attaching volume 42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 to /dev/vdb
Oct 23 20:07:49 user nova-compute[74429]: DEBUG os_brick.utils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:07:49 user nova-compute[74429]: INFO nova.compute.claims [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Claim successful on node user
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e131335-92e2-4c29-8396-d548bb52b81b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f46063-27b6-4b73-8194-4ebd3d3c1851]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f299bf05-b0ef-4818-a455-8905ccc8ca8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d25a8c1-4e2f-41a5-9fde-3f9ee2bdad30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:07:50 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7d00c-c039-4c6b-a79a-6cbc5033ed4d]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG os_brick.utils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating existing volume attachment record: 3ddf0567-c8f1-4413-bcd1-eb0eb600d085 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Updated VIF entry in instance network info cache for port affa2ce9-d72d-44c0-b31d-ad5b93b25cfe. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Updating instance_info_cache with network_info: [{"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-769fe6d9-58c0-462d-be7e-54653c438fd3 req-e21430f4-f172-4ab8-9421-fe6792827c82 service nova] Releasing lock "refresh_cache-f835ce97-1139-4849-85a8-df51f4b01627" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:07:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:07:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:07:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Creating image(s)
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "/opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "/opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.232s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.policy [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '191e8c37973f410ab676a8d3dd8428df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ae17fcb2e4268a3286fd7c6675952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-5682be6f-59a1-4101-97e2-69176901199d req-e0f7bfd4-cc0d-4e42-bb68-0055cb400c57 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5682be6f-59a1-4101-97e2-69176901199d req-e0f7bfd4-cc0d-4e42-bb68-0055cb400c57 service nova] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5682be6f-59a1-4101-97e2-69176901199d req-e0f7bfd4-cc0d-4e42-bb68-0055cb400c57 service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5682be6f-59a1-4101-97e2-69176901199d req-e0f7bfd4-cc0d-4e42-bb68-0055cb400c57 service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-5682be6f-59a1-4101-97e2-69176901199d req-e0f7bfd4-cc0d-4e42-bb68-0055cb400c57 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] No waiting events found dispatching network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:51 user nova-compute[74429]: WARNING nova.compute.manager [req-5682be6f-59a1-4101-97e2-69176901199d req-e0f7bfd4-cc0d-4e42-bb68-0055cb400c57 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received unexpected event network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe for instance with vm_state building and task_state spawning.
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.238s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk 1073741824" returned: 0 in 0.076s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.257s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:51 user nova-compute[74429]: INFO nova.compute.manager [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Terminating instance
Oct 23 20:07:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Cannot resize image /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Ensure instance console log exists: /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Successfully created port: 73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-1eca0b3d-be6a-4a31-bfe5-b01d0862098d req-c16f3bb9-81ef-417e-817b-c026e91579bb service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1eca0b3d-be6a-4a31-bfe5-b01d0862098d req-c16f3bb9-81ef-417e-817b-c026e91579bb service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1eca0b3d-be6a-4a31-bfe5-b01d0862098d req-c16f3bb9-81ef-417e-817b-c026e91579bb service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1eca0b3d-be6a-4a31-bfe5-b01d0862098d req-c16f3bb9-81ef-417e-817b-c026e91579bb service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-1eca0b3d-be6a-4a31-bfe5-b01d0862098d req-c16f3bb9-81ef-417e-817b-c026e91579bb service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-1eca0b3d-be6a-4a31-bfe5-b01d0862098d req-c16f3bb9-81ef-417e-817b-c026e91579bb service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-08e047dc-b906-4f12-8376-5143320b2875 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-c64eed12-ffbc-415f-a3fe-77bdac575732 req-b9f93adf-ef84-49a8-80e2-66fcef16913e service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c64eed12-ffbc-415f-a3fe-77bdac575732 req-b9f93adf-ef84-49a8-80e2-66fcef16913e service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c64eed12-ffbc-415f-a3fe-77bdac575732 req-b9f93adf-ef84-49a8-80e2-66fcef16913e service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c64eed12-ffbc-415f-a3fe-77bdac575732 req-b9f93adf-ef84-49a8-80e2-66fcef16913e service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-c64eed12-ffbc-415f-a3fe-77bdac575732 req-b9f93adf-ef84-49a8-80e2-66fcef16913e service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-c64eed12-ffbc-415f-a3fe-77bdac575732 req-b9f93adf-ef84-49a8-80e2-66fcef16913e service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] No waiting events found dispatching network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:53 user nova-compute[74429]: WARNING nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received unexpected event network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe for instance with vm_state building and task_state spawning.
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:53 user nova-compute[74429]: WARNING nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 for instance with vm_state active and task_state deleting.
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-b482176d-b452-4813-ad77-1ee2dc570b5d for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:53 user nova-compute[74429]: WARNING nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-b482176d-b452-4813-ad77-1ee2dc570b5d for instance with vm_state active and task_state deleting.
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1bbc2772-863b-4ad4-8645-fa0ec14acb94 req-85cfbc0e-768a-4456-97cc-5a3fd370fc47 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:07:53 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Successfully updated port: 73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "refresh_cache-8a7dae8a-3aba-4576-99a0-9b664ef79192" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquired lock "refresh_cache-8a7dae8a-3aba-4576-99a0-9b664ef79192" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:07:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Instance spawned successfully.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:07:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Instance destroyed successfully.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lazy-loading 'resources' on Instance uuid 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "address": "fa:16:3e:4a:80:30", "network": {"id": "903ac2ab-36d5-4dc9-85ff-232671d03f1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-464448995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a266f2-c5", "ovs_interfaceid": "76a266f2-c5cd-4169-ab6a-ad14e115b3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76a266f2-c5, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:54 user nova-compute[74429]: INFO nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Took 8.94 seconds to spawn the instance on the hypervisor.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=247e9292-e7b9-4a4e-a4cc-370132d3aca4) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:54 user nova-compute[74429]: INFO nova.compute.manager [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Took 10.20 seconds to build instance.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e34c6c88-db3c-4ca5-a7fc-1828e732c0c9 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "f835ce97-1139-4849-85a8-df51f4b01627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.354s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:80:30,bridge_name='br-int',has_traffic_filtering=True,id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4,network=Network(903ac2ab-36d5-4dc9-85ff-232671d03f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a266f2-c5')
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08e047dc-b9, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Updating instance_info_cache with network_info: [{"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Releasing lock "refresh_cache-8a7dae8a-3aba-4576-99a0-9b664ef79192" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Instance network_info: |[{"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Start _get_guest_xml network_info=[{"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39a00dd3-bf30-45da-97ae-eeed79a57029) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:54 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:54 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-858298132',display_name='tempest-VolumesNegativeTest-instance-858298132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-858298132',id=19,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466ae17fcb2e4268a3286fd7c6675952',ramdisk_id='',reservation_id='r-873azgcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-938656725',owner_user_name='tempest-VolumesNegativeTest-938656725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:07:51Z,user_data=None,user_id='191e8c37973f410ab676a8d3dd8428df',uuid=8a7dae8a-3aba-4576-99a0-9b664ef79192,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Converting VIF {"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a7dae8a-3aba-4576-99a0-9b664ef79192 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:f8,bridge_name='br-int',has_traffic_filtering=True,id=08e047dc-b906-4f12-8376-5143320b2875,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08e047dc-b9')
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81536a66-6e, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:07:54 user nova-compute[74429]:   <uuid>8a7dae8a-3aba-4576-99a0-9b664ef79192</uuid>
Oct 23 20:07:54 user nova-compute[74429]:   <name>instance-00000013</name>
Oct 23 20:07:54 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:07:54 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:07:54 user nova-compute[74429]:   <metadata>
Oct 23 20:07:54 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:07:54 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:07:54 user nova-compute[74429]:       <nova:name>tempest-VolumesNegativeTest-instance-858298132</nova:name>
Oct 23 20:07:54 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:07:54</nova:creationTime>
Oct 23 20:07:54 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:07:54 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:07:54 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:07:54 user nova-compute[74429]:       <nova:owner>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:user uuid="191e8c37973f410ab676a8d3dd8428df">tempest-VolumesNegativeTest-938656725-project-member</nova:user>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:project uuid="466ae17fcb2e4268a3286fd7c6675952">tempest-VolumesNegativeTest-938656725</nova:project>
Oct 23 20:07:54 user nova-compute[74429]:       </nova:owner>
Oct 23 20:07:54 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:07:54 user nova-compute[74429]:       <nova:ports>
Oct 23 20:07:54 user nova-compute[74429]:         <nova:port uuid="73bb7585-ef1d-4fcd-ba05-78960ec87240">
Oct 23 20:07:54 user nova-compute[74429]:           <nova:ip type="fixed" address="192.168.233.193" ipVersion="4"/>
Oct 23 20:07:54 user nova-compute[74429]:         </nova:port>
Oct 23 20:07:54 user nova-compute[74429]:       </nova:ports>
Oct 23 20:07:54 user nova-compute[74429]:     </nova:instance>
Oct 23 20:07:54 user nova-compute[74429]:   </metadata>
Oct 23 20:07:54 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:07:54 user nova-compute[74429]:     <system>
Oct 23 20:07:54 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:07:54 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:07:54 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:07:54 user nova-compute[74429]:       <entry name="serial">8a7dae8a-3aba-4576-99a0-9b664ef79192</entry>
Oct 23 20:07:54 user nova-compute[74429]:       <entry name="uuid">8a7dae8a-3aba-4576-99a0-9b664ef79192</entry>
Oct 23 20:07:54 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:07:54 user nova-compute[74429]:     </system>
Oct 23 20:07:54 user nova-compute[74429]:   </sysinfo>
Oct 23 20:07:54 user nova-compute[74429]:   <os>
Oct 23 20:07:54 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:07:54 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:07:54 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:07:54 user nova-compute[74429]:   </os>
Oct 23 20:07:54 user nova-compute[74429]:   <features>
Oct 23 20:07:54 user nova-compute[74429]:     <acpi/>
Oct 23 20:07:54 user nova-compute[74429]:     <apic/>
Oct 23 20:07:54 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:07:54 user nova-compute[74429]:   </features>
Oct 23 20:07:54 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:07:54 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:07:54 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:07:54 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:07:54 user nova-compute[74429]:   </clock>
Oct 23 20:07:54 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:07:54 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:07:54 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:07:54 user nova-compute[74429]:   </cpu>
Oct 23 20:07:54 user nova-compute[74429]:   <devices>
Oct 23 20:07:54 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:07:54 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:07:54 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk"/>
Oct 23 20:07:54 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:07:54 user nova-compute[74429]:     </disk>
Oct 23 20:07:54 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:07:54 user nova-compute[74429]:       <mac address="fa:16:3e:92:3b:3a"/>
Oct 23 20:07:54 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:54 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:07:54 user nova-compute[74429]:       <target dev="tap73bb7585-ef"/>
Oct 23 20:07:54 user nova-compute[74429]:     </interface>
Oct 23 20:07:54 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:07:54 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/console.log" append="off"/>
Oct 23 20:07:54 user nova-compute[74429]:     </serial>
Oct 23 20:07:54 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:07:54 user nova-compute[74429]:     <video>
Oct 23 20:07:54 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:07:54 user nova-compute[74429]:     </video>
Oct 23 20:07:54 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:07:54 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:07:54 user nova-compute[74429]:     </rng>
Oct 23 20:07:54 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:07:54 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:07:54 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:07:54 user nova-compute[74429]:     </memballoon>
Oct 23 20:07:54 user nova-compute[74429]:   </devices>
Oct 23 20:07:54 user nova-compute[74429]: </domain>
Oct 23 20:07:54 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-858298132',display_name='tempest-VolumesNegativeTest-instance-858298132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-858298132',id=19,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466ae17fcb2e4268a3286fd7c6675952',ramdisk_id='',reservation_id='r-873azgcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-938656725',owner_user_name='tempest-VolumesNegativeTest-938656725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:07:51Z,user_data=None,user_id='191e8c37973f410ab676a8d3dd8428df',uuid=8a7dae8a-3aba-4576-99a0-9b664ef79192,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Converting VIF {"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG os_vif [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c504ba5-a241-4eb6-9a02-786f88782473) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:54 user nova-compute[74429]: WARNING nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-08e047dc-b906-4f12-8376-5143320b2875 for instance with vm_state active and task_state deleting.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-0a880b39-b14a-486d-802b-315e5802de34 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:54 user nova-compute[74429]: WARNING nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-0a880b39-b14a-486d-802b-315e5802de34 for instance with vm_state active and task_state deleting.
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-changed-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Refreshing instance network info cache due to event network-changed-73bb7585-ef1d-4fcd-ba05-78960ec87240. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Acquiring lock "refresh_cache-8a7dae8a-3aba-4576-99a0-9b664ef79192" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Acquired lock "refresh_cache-8a7dae8a-3aba-4576-99a0-9b664ef79192" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.neutron [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Refreshing network info cache for port 73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef5a498e-2455-5cc9-809a-670d18f18c90', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:54 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=81536a66-6e9d-4fba-82aa-652c7b34e8c5,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81536a66-6e')
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with vm_state active and task_state deleting.
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-146d960d-25ab-46b0-b5ff-597a50999436 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-146d960d-25ab-46b0-b5ff-597a50999436 for instance with vm_state active and task_state deleting.
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with vm_state active and task_state deleting.
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with vm_state active and task_state deleting.
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-unplugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-a76e5470-93b3-46d6-9cee-46bc7dad7ed4 req-57f43d9c-5646-40b4-b1ef-3f2ac395f1ee service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-unplugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap146d960d-25, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73bb7585-ef, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73bb7585-ef, col_values=(('qos', UUID('30d8e3c2-4ae5-4252-8a2b-0b6ac664fb12')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73bb7585-ef, col_values=(('external_ids', {'iface-id': '73bb7585-ef1d-4fcd-ba05-78960ec87240', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:3b:3a', 'vm-uuid': '8a7dae8a-3aba-4576-99a0-9b664ef79192'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: INFO os_vif [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef')
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25ebb2c2-f5af-4e75-be2f-a923aa506b60) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:8c:08,bridge_name='br-int',has_traffic_filtering=True,id=146d960d-25ab-46b0-b5ff-597a50999436,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap146d960d-25')
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a880b39-b1, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] No VIF found with MAC fa:16:3e:92:3b:3a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e662533d-04fb-412e-90aa-8bdc87d84464) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.neutron [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Updated VIF entry in instance network info cache for port 73bb7585-ef1d-4fcd-ba05-78960ec87240. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.neutron [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Updating instance_info_cache with network_info: [{"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c6:f4,bridge_name='br-int',has_traffic_filtering=True,id=0a880b39-b14a-486d-802b-315e5802de34,network=Network(c732d6c2-1e28-47b0-ae97-28af7d77fc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a880b39-b1')
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3ef2a4e8-9b2b-479c-8719-3d9217a544f0 req-818cf5fe-4237-4f0b-b6ac-078e2d379ed9 service nova] Releasing lock "refresh_cache-8a7dae8a-3aba-4576-99a0-9b664ef79192" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb482176d-b4, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a153086-9ec8-4a20-8a0c-0fd8c872c34e) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ee:96,bridge_name='br-int',has_traffic_filtering=True,id=b482176d-b452-4813-ad77-1ee2dc570b5d,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb482176d-b4')
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-814297397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-814297397',id=12,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSG6U/ImvkUOC3ZdjRC5xP+jYzY93rkQPA8Ujbs1MF0m85Q8sxQ47KktGSSK7+kD1lwmRbRxpP0UhZBX3btlQA2opIjgKKmmG7Wo9P+q9JUeKVIn4kZE1tStHlDrPAmg==',key_name='tempest-keypair-1507575949',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd293746ce9041b2a5a489f369e0d35b',ramdisk_id='',reservation_id='r-snybo44s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-429215706',owner_user_name='tempest-TaggedBootDevicesTest-429215706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d78625b5d04ef4a79e9cd60c6b31d8',uuid=53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converting VIF {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6481d5aa-66, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3e3a887-0ddf-4177-b712-822c3eb3d930) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:55 user nova-compute[74429]: INFO os_vif [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:86:93,bridge_name='br-int',has_traffic_filtering=True,id=6481d5aa-66b4-4ab0-a0af-78c41dacef13,network=Network(11fa12f7-243a-4167-883a-ced3f0d21a13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6481d5aa-66')
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsqNxeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3278fd-5e79-40d3-958d-c789a1706933]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:07:55 user nova-compute[74429]: No targets found.
Oct 23 20:07:55 user nova-compute[74429]: iSNS:
Oct 23 20:07:55 user nova-compute[74429]: No targets found.
Oct 23 20:07:55 user nova-compute[74429]: STATIC:
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: FIRMWARE:
Oct 23 20:07:55 user nova-compute[74429]: No targets found.
Oct 23 20:07:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:07:55 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:07:55 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8b6fc2-0544-4a80-aa5e-4ea6e2357209]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0efe7d8-cb31-47f5-b746-8a6dd2eb7b44]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c5e3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-da5184ab-05b0-4c75-b89e-66b9c63f56bf req-a44a9891-9c61-42cc-8ed5-d297d5f13f85 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da5184ab-05b0-4c75-b89e-66b9c63f56bf req-a44a9891-9c61-42cc-8ed5-d297d5f13f85 service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da5184ab-05b0-4c75-b89e-66b9c63f56bf req-a44a9891-9c61-42cc-8ed5-d297d5f13f85 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da5184ab-05b0-4c75-b89e-66b9c63f56bf req-a44a9891-9c61-42cc-8ed5-d297d5f13f85 service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-da5184ab-05b0-4c75-b89e-66b9c63f56bf req-a44a9891-9c61-42cc-8ed5-d297d5f13f85 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING nova.compute.manager [req-da5184ab-05b0-4c75-b89e-66b9c63f56bf req-a44a9891-9c61-42cc-8ed5-d297d5f13f85 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-6481d5aa-66b4-4ab0-a0af-78c41dacef13 for instance with vm_state active and task_state deleting.
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde8500f-3a47-49bf-976f-12bbc290d2e8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71dd239-77bf-4a3b-8528-33bcb6fa112c]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81b927-ec68-4afb-a6a8-ea4fbf855109]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72bd71e-7440-4340-80d4-854261cfcf97]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c593154b-946a-4ce2-809b-09dcdf7fe0b1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3606e3a8-19e5-475c-ae7b-23418c57fa2c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260]
Oct 23 20:07:55 user nova-compute[74429]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573, portal: 172.16.0.220,3260] successful.
Oct 23 20:07:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09551b16-04fa-4c0c-bde5-232823622573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[95be2e93-e433-4b47-8fc8-425a504c76fa]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== disconnect_volume: return (390ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxWpdhSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:55 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6360d90-8a96-4952-ba77-40f65c2712cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:07:55 user nova-compute[74429]: No targets found.
Oct 23 20:07:55 user nova-compute[74429]: iSNS:
Oct 23 20:07:55 user nova-compute[74429]: No targets found.
Oct 23 20:07:55 user nova-compute[74429]: STATIC:
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:07:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:55 user nova-compute[74429]: FIRMWARE:
Oct 23 20:07:55 user nova-compute[74429]: No targets found.
Oct 23 20:07:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:07:56 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:07:56 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2460eeb-60e6-4fde-bc9a-3f705bdfe97e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed086e1-2431-4525-b946-4424cecbcf13]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580da0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc'): ({'sde'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Removing single pathed devices sde {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[92153e4d-bd88-49ff-a363-db6aca6e7b86]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e3a39-d0d1-4a70-be67-1316e30d5c05]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Flushing IO for device /dev/sde {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f76051-5082-4ac6-995a-01dab7d85b28]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68c0293-8cb7-4e36-b8f2-82071b8e7e67]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de03588c-8534-4b70-988c-96b53b6bcbb7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93b0ad-51a3-4eac-9da6-1ab2a171fb1d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260]
Oct 23 20:07:56 user nova-compute[74429]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc, portal: 172.16.0.220,3260] successful.
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c73d2a6-7aed-419c-8a72-d6b257b9c3bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[16134b8e-92bd-449f-9996-c279f9244c4a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== disconnect_volume: return (388ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OcCbGeuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:07:56 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dff0f9-dd56-488f-ac58-78a10b9f0dec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:07:56 user nova-compute[74429]: No targets found.
Oct 23 20:07:56 user nova-compute[74429]: iSNS:
Oct 23 20:07:56 user nova-compute[74429]: No targets found.
Oct 23 20:07:56 user nova-compute[74429]: STATIC:
Oct 23 20:07:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:07:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf
Oct 23 20:07:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085
Oct 23 20:07:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:07:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:07:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:07:56 user nova-compute[74429]: FIRMWARE:
Oct 23 20:07:56 user nova-compute[74429]: No targets found.
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:07:56 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:07:56 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e278745-31aa-4381-9f91-8dba593eff29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b41ccb-abe8-4a2f-9491-b918cb94d933]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580da0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf'): ({'sdf'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Removing single pathed devices sdf {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f033a9-84e2-4988-8ee4-80113c8d857a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[624914eb-b85d-47d7-8191-37380c7af386]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Flushing IO for device /dev/sdf {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5740de47-b7cc-4320-911d-55e17f758b9c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b016ccd-8bf4-4ddf-8f40-dc53bd1d0858]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] SCSI volumes sdf have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaeff03-b661-4a8d-9671-9e5de20a09ec]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c96516-470d-45ad-a7cb-16ea68a266f2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260]
Oct 23 20:07:56 user nova-compute[74429]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf, portal: 172.16.0.220,3260] successful.
Oct 23 20:07:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc551201-4f08-41f4-b82a-bb9e6aef03cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2112408a-fff3-4217-b3b8-bbec9a19be94]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] <== disconnect_volume: return (367ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:07:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Deleting instance files /opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc_del
Oct 23 20:07:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Deletion of /opt/stack/data/nova/instances/53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc_del complete
Oct 23 20:07:56 user nova-compute[74429]: INFO nova.compute.manager [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Took 4.86 seconds to destroy the instance on the hypervisor.
Oct 23 20:07:56 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:07:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-6c9b9635-ecb3-476a-8838-55a7ba3395a4 req-233ff94c-48ec-4e6c-b4f0-3f22459aca3e service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6c9b9635-ecb3-476a-8838-55a7ba3395a4 req-233ff94c-48ec-4e6c-b4f0-3f22459aca3e service nova] Acquiring lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6c9b9635-ecb3-476a-8838-55a7ba3395a4 req-233ff94c-48ec-4e6c-b4f0-3f22459aca3e service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6c9b9635-ecb3-476a-8838-55a7ba3395a4 req-233ff94c-48ec-4e6c-b4f0-3f22459aca3e service nova] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-6c9b9635-ecb3-476a-8838-55a7ba3395a4 req-233ff94c-48ec-4e6c-b4f0-3f22459aca3e service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] No waiting events found dispatching network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:57 user nova-compute[74429]: WARNING nova.compute.manager [req-6c9b9635-ecb3-476a-8838-55a7ba3395a4 req-233ff94c-48ec-4e6c-b4f0-3f22459aca3e service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received unexpected event network-vif-plugged-81536a66-6e9d-4fba-82aa-652c7b34e8c5 for instance with vm_state active and task_state deleting.
Oct 23 20:07:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e9a2f3c-4344-4815-8781-78466359dfa7 req-d1c93bf0-a824-48ab-bd29-716ba9cc38d0 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e9a2f3c-4344-4815-8781-78466359dfa7 req-d1c93bf0-a824-48ab-bd29-716ba9cc38d0 service nova] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e9a2f3c-4344-4815-8781-78466359dfa7 req-d1c93bf0-a824-48ab-bd29-716ba9cc38d0 service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e9a2f3c-4344-4815-8781-78466359dfa7 req-d1c93bf0-a824-48ab-bd29-716ba9cc38d0 service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e9a2f3c-4344-4815-8781-78466359dfa7 req-d1c93bf0-a824-48ab-bd29-716ba9cc38d0 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] No waiting events found dispatching network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:07:57 user nova-compute[74429]: WARNING nova.compute.manager [req-5e9a2f3c-4344-4815-8781-78466359dfa7 req-d1c93bf0-a824-48ab-bd29-716ba9cc38d0 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received unexpected event network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 for instance with vm_state building and task_state spawning.
Oct 23 20:07:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:07:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:07:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:07:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Instance spawned successfully.
Oct 23 20:07:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-afd70ba5-6430-4ac5-aec5-1f21b6d1f336 req-0750ae97-a75f-4e3e-af27-5326ce776b4c service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-afd70ba5-6430-4ac5-aec5-1f21b6d1f336 req-0750ae97-a75f-4e3e-af27-5326ce776b4c service nova] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-afd70ba5-6430-4ac5-aec5-1f21b6d1f336 req-0750ae97-a75f-4e3e-af27-5326ce776b4c service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-afd70ba5-6430-4ac5-aec5-1f21b6d1f336 req-0750ae97-a75f-4e3e-af27-5326ce776b4c service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-afd70ba5-6430-4ac5-aec5-1f21b6d1f336 req-0750ae97-a75f-4e3e-af27-5326ce776b4c service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] No waiting events found dispatching network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:00 user nova-compute[74429]: WARNING nova.compute.manager [req-afd70ba5-6430-4ac5-aec5-1f21b6d1f336 req-0750ae97-a75f-4e3e-af27-5326ce776b4c service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received unexpected event network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 for instance with vm_state building and task_state spawning.
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:00 user nova-compute[74429]: INFO nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Took 9.10 seconds to spawn the instance on the hypervisor.
Oct 23 20:08:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:08:00 user nova-compute[74429]: INFO nova.compute.manager [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Took 10.34 seconds to build instance.
Oct 23 20:08:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9ac85c9b-2b8b-4e7e-b200-75116c28de75 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.591s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-deleted-76a266f2-c5cd-4169-ab6a-ad14e115b3b4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:01 user nova-compute[74429]: INFO nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Neutron deleted interface 76a266f2-c5cd-4169-ab6a-ad14e115b3b4; detaching it from the instance and deleting it from the info cache
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "address": "fa:16:3e:ed:86:93", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6481d5aa-66", "ovs_interfaceid": "6481d5aa-66b4-4ab0-a0af-78c41dacef13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Detach interface failed, port_id=76a266f2-c5cd-4169-ab6a-ad14e115b3b4, reason: Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-deleted-6481d5aa-66b4-4ab0-a0af-78c41dacef13 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:01 user nova-compute[74429]: INFO nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Neutron deleted interface 6481d5aa-66b4-4ab0-a0af-78c41dacef13; detaching it from the instance and deleting it from the info cache
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b482176d-b452-4813-ad77-1ee2dc570b5d", "address": "fa:16:3e:70:ee:96", "network": {"id": "11fa12f7-243a-4167-883a-ced3f0d21a13", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068111759", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb482176d-b4", "ovs_interfaceid": "b482176d-b452-4813-ad77-1ee2dc570b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Detach interface failed, port_id=6481d5aa-66b4-4ab0-a0af-78c41dacef13, reason: Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-deleted-b482176d-b452-4813-ad77-1ee2dc570b5d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:01 user nova-compute[74429]: INFO nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Neutron deleted interface b482176d-b452-4813-ad77-1ee2dc570b5d; detaching it from the instance and deleting it from the info cache
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a880b39-b14a-486d-802b-315e5802de34", "address": "fa:16:3e:cd:c6:f4", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a880b39-b1", "ovs_interfaceid": "0a880b39-b14a-486d-802b-315e5802de34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Detach interface failed, port_id=b482176d-b452-4813-ad77-1ee2dc570b5d, reason: Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-deleted-0a880b39-b14a-486d-802b-315e5802de34 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:01 user nova-compute[74429]: INFO nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Neutron deleted interface 0a880b39-b14a-486d-802b-315e5802de34; detaching it from the instance and deleting it from the info cache
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [{"id": "08e047dc-b906-4f12-8376-5143320b2875", "address": "fa:16:3e:ed:a6:f8", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08e047dc-b9", "ovs_interfaceid": "08e047dc-b906-4f12-8376-5143320b2875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "address": "fa:16:3e:84:2d:07", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81536a66-6e", "ovs_interfaceid": "81536a66-6e9d-4fba-82aa-652c7b34e8c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "146d960d-25ab-46b0-b5ff-597a50999436", "address": "fa:16:3e:05:8c:08", "network": {"id": "c732d6c2-1e28-47b0-ae97-28af7d77fc13", "bridge": "br-int", "label": "tempest-device-tagging-net1-302832190", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd293746ce9041b2a5a489f369e0d35b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap146d960d-25", "ovs_interfaceid": "146d960d-25ab-46b0-b5ff-597a50999436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-372ae94d-9690-47dc-a4d6-ce570c3e93ab req-1ea82621-12d4-48e1-9c1e-f65bc7e5313b service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Detach interface failed, port_id=0a880b39-b14a-486d-802b-315e5802de34, reason: Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:08:02 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:02 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Took 5.44 seconds to deallocate network for instance.
Oct 23 20:08:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-1625b467-05d4-4058-b972-7b0754343f0e req-8936fa12-5446-4605-8f1d-ff74cf1e4483 service nova] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Received event network-vif-deleted-146d960d-25ab-46b0-b5ff-597a50999436 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 is timed out.
Oct 23 20:08:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully detached device vdb from instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 from the live domain config.
Oct 23 20:08:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klMpdyIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:08:10 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c43ad-7c65-4a78-a98a-0d017735feb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:08:10 user nova-compute[74429]: No targets found.
Oct 23 20:08:10 user nova-compute[74429]: iSNS:
Oct 23 20:08:10 user nova-compute[74429]: No targets found.
Oct 23 20:08:10 user nova-compute[74429]: STATIC:
Oct 23 20:08:10 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:08:10 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:08:10 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:08:10 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085
Oct 23 20:08:10 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:08:10 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:08:10 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:08:10 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:08:10 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:08:10 user nova-compute[74429]: FIRMWARE:
Oct 23 20:08:10 user nova-compute[74429]: No targets found.
Oct 23 20:08:10 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:08:10 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:08:10 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e63454-1b71-4242-9f63-52e8ad3a030c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6849b0ba-a5af-4500-bf8c-3307f135ef94]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:08:10 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:08:10 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:08:10 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:08:10 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:08:10 user nova-compute[74429]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 (non-flash)
Oct 23 20:08:10 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50752cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a96c1a9-4503-4245-b196-4fa150d0890e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2554fba-3803-40bf-b8b8-71c338648d82]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f42a59-240b-440b-ae59-b456b060307d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e069356-b4ab-4e93-8cf8-68af2eecc65e]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63a681-addf-4786-9c02-e69723556426]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a41297-28ac-4731-9a0f-d8dff7d0c799]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260]
Oct 23 20:08:10 user nova-compute[74429]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085, portal: 172.16.0.220,3260] successful.
Oct 23 20:08:10 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f08fefb8-5075-422e-99e7-6c424fa04085 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b9f80-cbe2-4450-ac83-9025fc3ff1e3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] <== disconnect_volume: return (346ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:08:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:08:11 user nova-compute[74429]: DEBUG nova.objects.instance [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'flavor' on Instance uuid 2bd6dbca-177e-4289-ac29-c7b114f72d00 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:08:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-beab1903-15ad-4014-be39-da20891c2ac0 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.678s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:08:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:08:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:08:12 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a243e4-fbd4-42ce-81cf-eccb1dfcb224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:08:12 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d1f215-d8e6-4e39-ae77-465b35a21e9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8] added
Oct 23 20:08:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503dbdc-c0da-4940-82a9-bbd20805ec62]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb19bf38-8e6f-4f82-946c-a02557bf1a3b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msAywLNn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msAywLNn" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[643c12fc-19e3-4751-a858-a73144e22ce9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msAywLNn'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb1d2c-60da-4316-a599-f022735ab1e1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef6583c-7ac3-47a9-90d5-f44850a39871]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ea1e3-7b7c-4f71-aab6-1975ac06011e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]
Oct 23 20:08:12 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.
Oct 23 20:08:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5807d92-b81e-451c-b3a7-d75e51eca675]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[34158449-11dc-4f9e-9330-35002536f703]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:08:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f093fcc-2ff0-4835-b72d-5aeb3b865899]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:08:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23532383332653565', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532383332653565', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:08:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:08:13 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:08:13 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:08:13 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:08:13 user nova-compute[74429]:   <serial>42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8</serial>
Oct 23 20:08:13 user nova-compute[74429]: </disk>
Oct 23 20:08:13 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:08:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:08:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:08:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No VIF found with MAC fa:16:3e:88:c1:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:08:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32e0171-e0b0-4f08-b67a-8ebf24baff72 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.734s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74429) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-1e6abc34-3146-499c-a5e4-819d458c4bd3 req-bedaef6b-baf0-4e6a-b53e-c99ee4c42ff2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1e6abc34-3146-499c-a5e4-819d458c4bd3 req-bedaef6b-baf0-4e6a-b53e-c99ee4c42ff2 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1e6abc34-3146-499c-a5e4-819d458c4bd3 req-bedaef6b-baf0-4e6a-b53e-c99ee4c42ff2 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1e6abc34-3146-499c-a5e4-819d458c4bd3 req-bedaef6b-baf0-4e6a-b53e-c99ee4c42ff2 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-1e6abc34-3146-499c-a5e4-819d458c4bd3 req-bedaef6b-baf0-4e6a-b53e-c99ee4c42ff2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:16 user nova-compute[74429]: WARNING nova.compute.manager [req-1e6abc34-3146-499c-a5e4-819d458c4bd3 req-bedaef6b-baf0-4e6a-b53e-c99ee4c42ff2 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state active and task_state powering-off.
Oct 23 20:08:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance destroyed successfully.
Oct 23 20:08:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d9664abd-813a-438f-8247-4b61944f1a50 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.918s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:08:16 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:08:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:08:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:08:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-af902750-dc7d-4801-8e35-ede5d47094bc req-0cc30993-7ecf-4cff-bde2-bf100f1cbde5 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-af902750-dc7d-4801-8e35-ede5d47094bc req-0cc30993-7ecf-4cff-bde2-bf100f1cbde5 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-af902750-dc7d-4801-8e35-ede5d47094bc req-0cc30993-7ecf-4cff-bde2-bf100f1cbde5 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-af902750-dc7d-4801-8e35-ede5d47094bc req-0cc30993-7ecf-4cff-bde2-bf100f1cbde5 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-af902750-dc7d-4801-8e35-ede5d47094bc req-0cc30993-7ecf-4cff-bde2-bf100f1cbde5 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:18 user nova-compute[74429]: WARNING nova.compute.manager [req-af902750-dc7d-4801-8e35-ede5d47094bc req-0cc30993-7ecf-4cff-bde2-bf100f1cbde5 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state None.
Oct 23 20:08:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:23 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:08:23 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7370MB free_disk=25.265880584716797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b02494e7-5fd0-4a23-ae27-252fdea795c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2bd6dbca-177e-4289-ac29-c7b114f72d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance f835ce97-1139-4849-85a8-df51f4b01627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8a7dae8a-3aba-4576-99a0-9b664ef79192 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:08:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:08:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:08:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:08:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:08:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:08:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "6c590343-5b24-4425-90be-423c44902c73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:08:31 user nova-compute[74429]: INFO nova.compute.claims [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Claim successful on node user
Oct 23 20:08:31 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:08:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:08:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.policy [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c660b1cec6dd476aa14a3d0fb74ebd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb9beb49ad42fbaf6d07c88babe563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:08:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Creating image(s)
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:08:32 user nova-compute[74429]: INFO nova.compute.claims [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Claim successful on node user
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk 1073741824" returned: 0 in 0.057s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Successfully created port: 866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:08:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Cannot resize image /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Ensure instance console log exists: /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.878s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.policy [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c660b1cec6dd476aa14a3d0fb74ebd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb9beb49ad42fbaf6d07c88babe563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:08:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Creating image(s)
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Successfully updated port: 866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-changed-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Refreshing instance network info cache due to event network-changed-866a6953-5f5d-4930-bf06-485bb37b77df. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Refreshing network info cache for port 866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Successfully created port: ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk 1073741824" returned: 0 in 0.055s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-94520b33-a46a-45c3-a8cf-1a6ad3506cff req-9fc36816-e52e-4330-879d-b07178ba3fd0 service nova] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:08:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Cannot resize image /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Ensure instance console log exists: /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance network_info: |[{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Start _get_guest_xml network_info=[{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:08:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:08:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1207176885',display_name='tempest-ServerRescueNegativeTestJSON-server-1207176885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1207176885',id=20,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-0v5arxxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:32Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=6c590343-5b24-4425-90be-423c44902c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.objects.instance [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:08:34 user nova-compute[74429]:   <uuid>6c590343-5b24-4425-90be-423c44902c73</uuid>
Oct 23 20:08:34 user nova-compute[74429]:   <name>instance-00000014</name>
Oct 23 20:08:34 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:08:34 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:08:34 user nova-compute[74429]:   <metadata>
Oct 23 20:08:34 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:08:34 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1207176885</nova:name>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:08:34</nova:creationTime>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:08:34 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:08:34 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:owner>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:user uuid="c660b1cec6dd476aa14a3d0fb74ebd4a">tempest-ServerRescueNegativeTestJSON-1224059578-project-member</nova:user>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:project uuid="9dbb9beb49ad42fbaf6d07c88babe563">tempest-ServerRescueNegativeTestJSON-1224059578</nova:project>
Oct 23 20:08:34 user nova-compute[74429]:       </nova:owner>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:ports>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:port uuid="866a6953-5f5d-4930-bf06-485bb37b77df">
Oct 23 20:08:34 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 20:08:34 user nova-compute[74429]:         </nova:port>
Oct 23 20:08:34 user nova-compute[74429]:       </nova:ports>
Oct 23 20:08:34 user nova-compute[74429]:     </nova:instance>
Oct 23 20:08:34 user nova-compute[74429]:   </metadata>
Oct 23 20:08:34 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:08:34 user nova-compute[74429]:     <system>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="serial">6c590343-5b24-4425-90be-423c44902c73</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="uuid">6c590343-5b24-4425-90be-423c44902c73</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:08:34 user nova-compute[74429]:     </system>
Oct 23 20:08:34 user nova-compute[74429]:   </sysinfo>
Oct 23 20:08:34 user nova-compute[74429]:   <os>
Oct 23 20:08:34 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:08:34 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:08:34 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:08:34 user nova-compute[74429]:   </os>
Oct 23 20:08:34 user nova-compute[74429]:   <features>
Oct 23 20:08:34 user nova-compute[74429]:     <acpi/>
Oct 23 20:08:34 user nova-compute[74429]:     <apic/>
Oct 23 20:08:34 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:08:34 user nova-compute[74429]:   </features>
Oct 23 20:08:34 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:08:34 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:08:34 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:08:34 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:08:34 user nova-compute[74429]:   </clock>
Oct 23 20:08:34 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:08:34 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:08:34 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:08:34 user nova-compute[74429]:   </cpu>
Oct 23 20:08:34 user nova-compute[74429]:   <devices>
Oct 23 20:08:34 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:08:34 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:08:34 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk"/>
Oct 23 20:08:34 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:08:34 user nova-compute[74429]:     </disk>
Oct 23 20:08:34 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:08:34 user nova-compute[74429]:       <mac address="fa:16:3e:68:98:f0"/>
Oct 23 20:08:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:08:34 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:08:34 user nova-compute[74429]:       <target dev="tap866a6953-5f"/>
Oct 23 20:08:34 user nova-compute[74429]:     </interface>
Oct 23 20:08:34 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:08:34 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/console.log" append="off"/>
Oct 23 20:08:34 user nova-compute[74429]:     </serial>
Oct 23 20:08:34 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:08:34 user nova-compute[74429]:     <video>
Oct 23 20:08:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:08:34 user nova-compute[74429]:     </video>
Oct 23 20:08:34 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:08:34 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:08:34 user nova-compute[74429]:     </rng>
Oct 23 20:08:34 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:08:34 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:08:34 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:08:34 user nova-compute[74429]:     </memballoon>
Oct 23 20:08:34 user nova-compute[74429]:   </devices>
Oct 23 20:08:34 user nova-compute[74429]: </domain>
Oct 23 20:08:34 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1207176885',display_name='tempest-ServerRescueNegativeTestJSON-server-1207176885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1207176885',id=20,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-0v5arxxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:32Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=6c590343-5b24-4425-90be-423c44902c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG os_vif [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Successfully updated port: ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3fc7df1-a74d-5025-a68e-746cb1d513de', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap866a6953-5f, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap866a6953-5f, col_values=(('qos', UUID('f5a92778-70c5-44dc-8dbc-31b6a5df18a8')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap866a6953-5f, col_values=(('external_ids', {'iface-id': '866a6953-5f5d-4930-bf06-485bb37b77df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:98:f0', 'vm-uuid': '6c590343-5b24-4425-90be-423c44902c73'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-changed-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Refreshing instance network info cache due to event network-changed-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] Acquiring lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: INFO os_vif [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f')
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:68:98:f0, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updating instance_info_cache with network_info: [{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance network_info: |[{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] Acquired lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Refreshing network info cache for port ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Start _get_guest_xml network_info=[{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:08:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:08:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1324301041',display_name='tempest-ServerRescueNegativeTestJSON-server-1324301041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1324301041',id=21,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-2bginkvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:33Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=36eb1960-5d84-4bd7-bf9b-878cfb13196f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.objects.instance [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'pci_devices' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:08:34 user nova-compute[74429]:   <uuid>36eb1960-5d84-4bd7-bf9b-878cfb13196f</uuid>
Oct 23 20:08:34 user nova-compute[74429]:   <name>instance-00000015</name>
Oct 23 20:08:34 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:08:34 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:08:34 user nova-compute[74429]:   <metadata>
Oct 23 20:08:34 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:08:34 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1324301041</nova:name>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:08:34</nova:creationTime>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:08:34 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:08:34 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:owner>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:user uuid="c660b1cec6dd476aa14a3d0fb74ebd4a">tempest-ServerRescueNegativeTestJSON-1224059578-project-member</nova:user>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:project uuid="9dbb9beb49ad42fbaf6d07c88babe563">tempest-ServerRescueNegativeTestJSON-1224059578</nova:project>
Oct 23 20:08:34 user nova-compute[74429]:       </nova:owner>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:08:34 user nova-compute[74429]:       <nova:ports>
Oct 23 20:08:34 user nova-compute[74429]:         <nova:port uuid="ff08b5cd-ef87-48a7-b09c-22b7adc1a88c">
Oct 23 20:08:34 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:08:34 user nova-compute[74429]:         </nova:port>
Oct 23 20:08:34 user nova-compute[74429]:       </nova:ports>
Oct 23 20:08:34 user nova-compute[74429]:     </nova:instance>
Oct 23 20:08:34 user nova-compute[74429]:   </metadata>
Oct 23 20:08:34 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:08:34 user nova-compute[74429]:     <system>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="serial">36eb1960-5d84-4bd7-bf9b-878cfb13196f</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="uuid">36eb1960-5d84-4bd7-bf9b-878cfb13196f</entry>
Oct 23 20:08:34 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:08:34 user nova-compute[74429]:     </system>
Oct 23 20:08:34 user nova-compute[74429]:   </sysinfo>
Oct 23 20:08:34 user nova-compute[74429]:   <os>
Oct 23 20:08:34 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:08:34 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:08:34 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:08:34 user nova-compute[74429]:   </os>
Oct 23 20:08:34 user nova-compute[74429]:   <features>
Oct 23 20:08:34 user nova-compute[74429]:     <acpi/>
Oct 23 20:08:34 user nova-compute[74429]:     <apic/>
Oct 23 20:08:34 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:08:34 user nova-compute[74429]:   </features>
Oct 23 20:08:34 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:08:34 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:08:34 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:08:34 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:08:34 user nova-compute[74429]:   </clock>
Oct 23 20:08:34 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:08:34 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:08:34 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:08:34 user nova-compute[74429]:   </cpu>
Oct 23 20:08:34 user nova-compute[74429]:   <devices>
Oct 23 20:08:34 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:08:34 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:08:34 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk"/>
Oct 23 20:08:34 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:08:34 user nova-compute[74429]:     </disk>
Oct 23 20:08:34 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:08:34 user nova-compute[74429]:       <mac address="fa:16:3e:f2:75:2a"/>
Oct 23 20:08:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:08:34 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:08:34 user nova-compute[74429]:       <target dev="tapff08b5cd-ef"/>
Oct 23 20:08:34 user nova-compute[74429]:     </interface>
Oct 23 20:08:34 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:08:34 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/console.log" append="off"/>
Oct 23 20:08:34 user nova-compute[74429]:     </serial>
Oct 23 20:08:34 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:08:34 user nova-compute[74429]:     <video>
Oct 23 20:08:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:08:34 user nova-compute[74429]:     </video>
Oct 23 20:08:34 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:08:34 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:08:34 user nova-compute[74429]:     </rng>
Oct 23 20:08:34 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:08:34 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:08:34 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:08:34 user nova-compute[74429]:     </memballoon>
Oct 23 20:08:34 user nova-compute[74429]:   </devices>
Oct 23 20:08:34 user nova-compute[74429]: </domain>
Oct 23 20:08:34 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1324301041',display_name='tempest-ServerRescueNegativeTestJSON-server-1324301041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1324301041',id=21,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-2bginkvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:33Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=36eb1960-5d84-4bd7-bf9b-878cfb13196f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG os_vif [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7f11a27-5505-557a-9749-01c5adf7a026', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff08b5cd-ef, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff08b5cd-ef, col_values=(('qos', UUID('560f8857-cbf3-42c7-a61a-19acb32dec41')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff08b5cd-ef, col_values=(('external_ids', {'iface-id': 'ff08b5cd-ef87-48a7-b09c-22b7adc1a88c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:75:2a', 'vm-uuid': '36eb1960-5d84-4bd7-bf9b-878cfb13196f'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:34 user nova-compute[74429]: INFO os_vif [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef')
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:08:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:f2:75:2a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:08:35 user nova-compute[74429]: DEBUG nova.network.neutron [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updated VIF entry in instance network info cache for port ff08b5cd-ef87-48a7-b09c-22b7adc1a88c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:08:35 user nova-compute[74429]: DEBUG nova.network.neutron [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updating instance_info_cache with network_info: [{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-956951c7-443e-464b-b29a-ae9c341bb27b req-c30d208a-7844-4867-a98f-7fcc2a92b9f9 service nova] Releasing lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:08:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-19edf3b3-c329-4f9f-b348-a54cc2f94b10 req-984bd753-a0ff-4166-b727-a882c96d71ce service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19edf3b3-c329-4f9f-b348-a54cc2f94b10 req-984bd753-a0ff-4166-b727-a882c96d71ce service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19edf3b3-c329-4f9f-b348-a54cc2f94b10 req-984bd753-a0ff-4166-b727-a882c96d71ce service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19edf3b3-c329-4f9f-b348-a54cc2f94b10 req-984bd753-a0ff-4166-b727-a882c96d71ce service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-19edf3b3-c329-4f9f-b348-a54cc2f94b10 req-984bd753-a0ff-4166-b727-a882c96d71ce service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:37 user nova-compute[74429]: WARNING nova.compute.manager [req-19edf3b3-c329-4f9f-b348-a54cc2f94b10 req-984bd753-a0ff-4166-b727-a882c96d71ce service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state building and task_state spawning.
Oct 23 20:08:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:39 user nova-compute[74429]: WARNING nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state building and task_state spawning.
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:39 user nova-compute[74429]: WARNING nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state building and task_state spawning.
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:39 user nova-compute[74429]: WARNING nova.compute.manager [req-cd909346-82b5-4b6d-a370-9fd6551f911a req-1da8cc52-d209-4328-a9a3-118757dd61bc service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state building and task_state spawning.
Oct 23 20:08:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:39 user nova-compute[74429]: INFO nova.compute.manager [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Terminating instance
Oct 23 20:08:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance spawned successfully.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance spawned successfully.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Took 8.19 seconds to spawn the instance on the hypervisor.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Took 7.12 seconds to spawn the instance on the hypervisor.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.compute.manager [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Took 8.38 seconds to build instance.
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.compute.manager [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Took 9.22 seconds to build instance.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1a104141-dfa3-4a6c-bace-9e473ffbfd20 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.491s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-170f8c18-dcfa-4e90-b68a-75aacf3fb09e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "6c590343-5b24-4425-90be-423c44902c73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.332s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Instance destroyed successfully.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.objects.instance [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'resources' on Instance uuid 2bd6dbca-177e-4289-ac29-c7b114f72d00 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1477910682',display_name='tempest-TestStampPattern-server-1477910682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1477910682',id=15,image_ref='eb9ee1b1-f223-4691-978d-9bb470a2c377',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UEGx8zY0R42EfuCAeeZ9GcoX+fKO6uxcXyPESeKU8tZbyBeoCemxWqY8zrVqk2YCKJ1oYbgTDCWR7zsf+i7gwTf2tIe3iSvwUxABB+ro2StTbFJpgMxD50UDdJ16VlQ==',key_name='tempest-TestStampPattern-310945430',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74dd7809fa6b4cf185a02e8ffc0f5439',ramdisk_id='',reservation_id='r-emflse78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853',image_min_disk='1',image_min_ram='0',image_owner_id='74dd7809fa6b4cf185a02e8ffc0f5439',image_owner_project_name='tempest-TestStampPattern-1617962097',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1617962097-project-member',image_user_id='c600566c5fef49bdabb57bc0f8233049',owner_project_name='tempest-TestStampPattern-1617962097',owner_user_name='tempest-TestStampPattern-1617962097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:05:36Z,user_data=None,user_id='c600566c5fef49bdabb57bc0f8233049',uuid=2bd6dbca-177e-4289-ac29-c7b114f72d00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converting VIF {"id": "3692c2a8-df8e-48f8-b286-dcb406283c67", "address": "fa:16:3e:da:12:d3", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3692c2a8-df", "ovs_interfaceid": "3692c2a8-df8e-48f8-b286-dcb406283c67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG os_vif [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3692c2a8-df, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e397c9e-1d74-4af1-b880-d40391fb0699) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:40 user nova-compute[74429]: INFO os_vif [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:12:d3,bridge_name='br-int',has_traffic_filtering=True,id=3692c2a8-df8e-48f8-b286-dcb406283c67,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3692c2a8-df')
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Deleting instance files /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00_del
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Deletion of /opt/stack/data/nova/instances/2bd6dbca-177e-4289-ac29-c7b114f72d00_del complete
Oct 23 20:08:40 user nova-compute[74429]: INFO nova.compute.manager [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 23 20:08:40 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:08:40 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-changed-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Refreshing instance network info cache due to event network-changed-3692c2a8-df8e-48f8-b286-dcb406283c67. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Acquiring lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Acquired lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Refreshing network info cache for port 3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:41 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Took 0.58 seconds to deallocate network for instance.
Oct 23 20:08:41 user nova-compute[74429]: INFO nova.network.neutron [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Port 3692c2a8-df8e-48f8-b286-dcb406283c67 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-a8e1a8eb-30eb-4d30-bcf6-84343dc4ca9d req-049dc6c3-1dd2-4844-89a1-05b034fb15e5 service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-vif-deleted-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Releasing lock "refresh_cache-2bd6dbca-177e-4289-ac29-c7b114f72d00" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-vif-unplugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] No waiting events found dispatching network-vif-unplugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-vif-unplugged-3692c2a8-df8e-48f8-b286-dcb406283c67 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received event network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Acquiring lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] No waiting events found dispatching network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:08:41 user nova-compute[74429]: WARNING nova.compute.manager [req-3c828215-0c4b-456b-b158-56331fbfa4cc req-aef66604-9a18-4ee3-88af-e471b05c36be service nova] [instance: 2bd6dbca-177e-4289-ac29-c7b114f72d00] Received unexpected event network-vif-plugged-3692c2a8-df8e-48f8-b286-dcb406283c67 for instance with vm_state active and task_state deleting.
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:42 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:08:42 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:08:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:42 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Deleted allocations for instance 2bd6dbca-177e-4289-ac29-c7b114f72d00
Oct 23 20:08:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2de3fcb4-d39d-4b02-a060-449729506152 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "2bd6dbca-177e-4289-ac29-c7b114f72d00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:46 user nova-compute[74429]: INFO nova.compute.manager [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] [instance: 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc] Took 44.56 seconds to detach 3 volumes for instance.
Oct 23 20:08:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:08:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:08:47 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:08:47 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:08:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.703s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:47 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Deleted allocations for instance 53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc
Oct 23 20:08:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f937951f-2b14-438e-9918-fdfeea26477f tempest-TaggedBootDevicesTest-429215706 tempest-TaggedBootDevicesTest-429215706-project-member] Lock "53d1f1ba-8e8e-48b2-b1a6-d5e89003a1bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 55.832s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:08:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:08:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:08:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:08:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:08:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:08:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:16 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updating instance_info_cache with network_info: [{"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-b02494e7-5fd0-4a23-ae27-252fdea795c9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:09:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:23 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:09:23 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:09:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7200MB free_disk=25.195335388183594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:09:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b02494e7-5fd0-4a23-ae27-252fdea795c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 44034c15-e9c6-466b-959a-534b818bab5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance f835ce97-1139-4849-85a8-df51f4b01627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8a7dae8a-3aba-4576-99a0-9b664ef79192 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:09:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:09:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:09:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-changed-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Refreshing instance network info cache due to event network-changed-7e1f1772-e866-4eda-a7aa-d62a94d9f560. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:09:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] Acquiring lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:09:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] Acquired lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:09:28 user nova-compute[74429]: DEBUG nova.network.neutron [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Refreshing network info cache for port 7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updated VIF entry in instance network info cache for port 7e1f1772-e866-4eda-a7aa-d62a94d9f560. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updating instance_info_cache with network_info: [{"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'flavor' on Instance uuid b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-35851ef9-2af4-4f16-a38d-0240c0134cd1 req-423d0d15-e5ef-4d40-920a-b91fc4ba88ff service nova] Releasing lock "refresh_cache-b3df83c8-d19c-4eee-b1be-80a2ce516d5c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:29 user nova-compute[74429]: INFO nova.compute.manager [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attaching volume 3a5565ff-d242-42c5-91ce-6c81ad7dc70f to /dev/vdb
Oct 23 20:09:29 user nova-compute[74429]: DEBUG os_brick.utils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c4467-13a1-406a-a585-2c07492fbdcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323f803-c1ab-4361-bf35-23a0594021e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bf3cf6-8ed1-4cd7-a1d8-967a83814baf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0ff114-83f0-4cdc-b9e7-684a80bfc687]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:09:29 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:09:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a47cbc-b9cc-4513-bcca-655fad8146ca]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG os_brick.utils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:09:29 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updating existing volume attachment record: e1374afd-3302-44db-b049-41f12406658c {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:09:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dfa666c7-491b-41e3-8beb-165b4081235f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:09:35 user nova-compute[74429]: INFO nova.compute.claims [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Claim successful on node user
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:09:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG nova.policy [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '734b0b0d04104bfeab582780b77764cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201753405b7c4553af3b39f82311a3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:09:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:09:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Creating image(s)
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "/opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "/opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.216s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk 1073741824" returned: 0 in 0.071s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Successfully created port: 45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.233s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Cannot resize image /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Ensure instance console log exists: /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Successfully updated port: 45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "refresh_cache-dfa666c7-491b-41e3-8beb-165b4081235f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquired lock "refresh_cache-dfa666c7-491b-41e3-8beb-165b4081235f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-changed-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Refreshing instance network info cache due to event network-changed-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] Acquiring lock "refresh_cache-dfa666c7-491b-41e3-8beb-165b4081235f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:09:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Updating instance_info_cache with network_info: [{"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Releasing lock "refresh_cache-dfa666c7-491b-41e3-8beb-165b4081235f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Instance network_info: |[{"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] Acquired lock "refresh_cache-dfa666c7-491b-41e3-8beb-165b4081235f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.neutron [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Refreshing network info cache for port 45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Start _get_guest_xml network_info=[{"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:09:38 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:09:38 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1220970340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1220970340',id=22,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-6numxypv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:09:36Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=dfa666c7-491b-41e3-8beb-165b4081235f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'pci_devices' on Instance uuid dfa666c7-491b-41e3-8beb-165b4081235f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:09:38 user nova-compute[74429]:   <uuid>dfa666c7-491b-41e3-8beb-165b4081235f</uuid>
Oct 23 20:09:38 user nova-compute[74429]:   <name>instance-00000016</name>
Oct 23 20:09:38 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:09:38 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:09:38 user nova-compute[74429]:   <metadata>
Oct 23 20:09:38 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:09:38 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:09:38 user nova-compute[74429]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1220970340</nova:name>
Oct 23 20:09:38 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:09:38</nova:creationTime>
Oct 23 20:09:38 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:09:38 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:09:38 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:09:38 user nova-compute[74429]:       <nova:owner>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:user uuid="734b0b0d04104bfeab582780b77764cf">tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member</nova:user>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:project uuid="201753405b7c4553af3b39f82311a3d2">tempest-ServerBootFromVolumeStableRescueTest-1279644555</nova:project>
Oct 23 20:09:38 user nova-compute[74429]:       </nova:owner>
Oct 23 20:09:38 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:09:38 user nova-compute[74429]:       <nova:ports>
Oct 23 20:09:38 user nova-compute[74429]:         <nova:port uuid="45263d8f-f81c-446e-8c6e-0b6aaba8e5e4">
Oct 23 20:09:38 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:09:38 user nova-compute[74429]:         </nova:port>
Oct 23 20:09:38 user nova-compute[74429]:       </nova:ports>
Oct 23 20:09:38 user nova-compute[74429]:     </nova:instance>
Oct 23 20:09:38 user nova-compute[74429]:   </metadata>
Oct 23 20:09:38 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:09:38 user nova-compute[74429]:     <system>
Oct 23 20:09:38 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:09:38 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:09:38 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:09:38 user nova-compute[74429]:       <entry name="serial">dfa666c7-491b-41e3-8beb-165b4081235f</entry>
Oct 23 20:09:38 user nova-compute[74429]:       <entry name="uuid">dfa666c7-491b-41e3-8beb-165b4081235f</entry>
Oct 23 20:09:38 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:09:38 user nova-compute[74429]:     </system>
Oct 23 20:09:38 user nova-compute[74429]:   </sysinfo>
Oct 23 20:09:38 user nova-compute[74429]:   <os>
Oct 23 20:09:38 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:09:38 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:09:38 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:09:38 user nova-compute[74429]:   </os>
Oct 23 20:09:38 user nova-compute[74429]:   <features>
Oct 23 20:09:38 user nova-compute[74429]:     <acpi/>
Oct 23 20:09:38 user nova-compute[74429]:     <apic/>
Oct 23 20:09:38 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:09:38 user nova-compute[74429]:   </features>
Oct 23 20:09:38 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:09:38 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:09:38 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:09:38 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:09:38 user nova-compute[74429]:   </clock>
Oct 23 20:09:38 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:09:38 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:09:38 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:09:38 user nova-compute[74429]:   </cpu>
Oct 23 20:09:38 user nova-compute[74429]:   <devices>
Oct 23 20:09:38 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:09:38 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:09:38 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk"/>
Oct 23 20:09:38 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:09:38 user nova-compute[74429]:     </disk>
Oct 23 20:09:38 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:09:38 user nova-compute[74429]:       <mac address="fa:16:3e:73:e5:a5"/>
Oct 23 20:09:38 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:09:38 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:09:38 user nova-compute[74429]:       <target dev="tap45263d8f-f8"/>
Oct 23 20:09:38 user nova-compute[74429]:     </interface>
Oct 23 20:09:38 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:09:38 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/console.log" append="off"/>
Oct 23 20:09:38 user nova-compute[74429]:     </serial>
Oct 23 20:09:38 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:09:38 user nova-compute[74429]:     <video>
Oct 23 20:09:38 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:09:38 user nova-compute[74429]:     </video>
Oct 23 20:09:38 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:09:38 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:09:38 user nova-compute[74429]:     </rng>
Oct 23 20:09:38 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:09:38 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:09:38 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:09:38 user nova-compute[74429]:     </memballoon>
Oct 23 20:09:38 user nova-compute[74429]:   </devices>
Oct 23 20:09:38 user nova-compute[74429]: </domain>
Oct 23 20:09:38 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1220970340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1220970340',id=22,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-6numxypv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:09:36Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=dfa666c7-491b-41e3-8beb-165b4081235f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG os_vif [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '491ab80c-8b29-52a1-81fb-8c7f9ec1a602', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45263d8f-f8, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45263d8f-f8, col_values=(('qos', UUID('328a3205-7571-4f20-97cd-f2aa26e7d3cf')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45263d8f-f8, col_values=(('external_ids', {'iface-id': '45263d8f-f81c-446e-8c6e-0b6aaba8e5e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e5:a5', 'vm-uuid': 'dfa666c7-491b-41e3-8beb-165b4081235f'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: INFO os_vif [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8')
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] No VIF found with MAC fa:16:3e:73:e5:a5, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:38 user nova-compute[74429]: INFO nova.compute.manager [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Terminating instance
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.neutron [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Updated VIF entry in instance network info cache for port 45263d8f-f81c-446e-8c6e-0b6aaba8e5e4. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG nova.network.neutron [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Updating instance_info_cache with network_info: [{"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-846fc65c-a152-4e61-8aab-93fad31f01e7 req-e54fcb1a-01d1-45f8-9456-54f32ea57249 service nova] Releasing lock "refresh_cache-dfa666c7-491b-41e3-8beb-165b4081235f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-50293835-28e3-4d4d-a032-66b54d70cbc3 req-deec0bd2-71bf-4086-b46f-4c8327872fbd service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-50293835-28e3-4d4d-a032-66b54d70cbc3 req-deec0bd2-71bf-4086-b46f-4c8327872fbd service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-50293835-28e3-4d4d-a032-66b54d70cbc3 req-deec0bd2-71bf-4086-b46f-4c8327872fbd service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-50293835-28e3-4d4d-a032-66b54d70cbc3 req-deec0bd2-71bf-4086-b46f-4c8327872fbd service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-50293835-28e3-4d4d-a032-66b54d70cbc3 req-deec0bd2-71bf-4086-b46f-4c8327872fbd service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-50293835-28e3-4d4d-a032-66b54d70cbc3 req-deec0bd2-71bf-4086-b46f-4c8327872fbd service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-unplugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:39 user nova-compute[74429]: INFO nova.compute.manager [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Terminating instance
Oct 23 20:09:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Instance destroyed successfully.
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.objects.instance [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lazy-loading 'resources' on Instance uuid 44034c15-e9c6-466b-959a-534b818bab5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-594920033',display_name='tempest-ServerActionsTestOtherB-server-594920033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-594920033',id=3,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+bqP6Ik4UW2iy5uiIzxZSGBL7HAJg+a1inUS3zm5UjTsIjCXNLpliLEG/905vfcDPsndVzIcWTA7J4dxKk1S/c4WONWHijpOqyjkZInXW9CTbSG3gH7DezoZrR0ndUw==',key_name='tempest-keypair-1687235131',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:07:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f07fe256e3f84a4594ecccfc011aeea3',ramdisk_id='',reservation_id='r-1g0ahk15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1184256079',owner_user_name='tempest-ServerActionsTestOtherB-1184256079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dc4633f95ff40f4a2859c6673112f94',uuid=44034c15-e9c6-466b-959a-534b818bab5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converting VIF {"id": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "address": "fa:16:3e:7f:dd:c6", "network": {"id": "20e9ce39-48b1-4d03-96ca-14096c7f4cfc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-961027824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f07fe256e3f84a4594ecccfc011aeea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a5270f-79", "ovs_interfaceid": "a6a5270f-79da-4735-a1f4-5bc0fac5259d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_vif [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6a5270f-79, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66d5175a-e9f1-4bf2-aa0c-b657e9017cb5) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: INFO os_vif [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:dd:c6,bridge_name='br-int',has_traffic_filtering=True,id=a6a5270f-79da-4735-a1f4-5bc0fac5259d,network=Network(20e9ce39-48b1-4d03-96ca-14096c7f4cfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a5270f-79')
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Zfxzdcph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:09:40 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc436dd-2aed-4902-b2c7-37e882894d7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:09:40 user nova-compute[74429]: No targets found.
Oct 23 20:09:40 user nova-compute[74429]: iSNS:
Oct 23 20:09:40 user nova-compute[74429]: No targets found.
Oct 23 20:09:40 user nova-compute[74429]: STATIC:
Oct 23 20:09:40 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:09:40 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:09:40 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:09:40 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8
Oct 23 20:09:40 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:09:40 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:09:40 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0
Oct 23 20:09:40 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:09:40 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:09:40 user nova-compute[74429]: FIRMWARE:
Oct 23 20:09:40 user nova-compute[74429]: No targets found.
Oct 23 20:09:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:09:40 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:09:40 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f8c047-6b1f-4529-865d-5c98e2fabde8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a5d458-fb5e-4b35-8461-8c4b35ff333e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:40 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:09:40 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:40 user nova-compute[74429]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 (non-flash)
Oct 23 20:09:40 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d505985e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22333b6-9f32-4fc7-a376-c03a66da6098]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec629d1-24f8-4824-a79d-1aab4504c719]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[21756424-bea7-473e-8f16-2d76a0f8c8c6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[25caf8ad-feaa-4aef-80fa-695753bfb039]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-635d911a-7532-49bd-9e26-8c9fd1c009f8 req-9e11dc95-dc8b-406c-8a7c-6e25f086c6b1 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-vif-unplugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-635d911a-7532-49bd-9e26-8c9fd1c009f8 req-9e11dc95-dc8b-406c-8a7c-6e25f086c6b1 service nova] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-635d911a-7532-49bd-9e26-8c9fd1c009f8 req-9e11dc95-dc8b-406c-8a7c-6e25f086c6b1 service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-635d911a-7532-49bd-9e26-8c9fd1c009f8 req-9e11dc95-dc8b-406c-8a7c-6e25f086c6b1 service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-635d911a-7532-49bd-9e26-8c9fd1c009f8 req-9e11dc95-dc8b-406c-8a7c-6e25f086c6b1 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] No waiting events found dispatching network-vif-unplugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-635d911a-7532-49bd-9e26-8c9fd1c009f8 req-9e11dc95-dc8b-406c-8a7c-6e25f086c6b1 service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-vif-unplugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0898081-0af7-4ff9-8f72-3ec666457ade]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32ef1e7-9287-452f-a32e-5342fa4bc02c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260]
Oct 23 20:09:40 user nova-compute[74429]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0, portal: 172.16.0.220,3260] successful.
Oct 23 20:09:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ff430d-b88f-48f3-81c0-888a3f5c75d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d92d0ce-1f0c-408f-ad5d-37bc156cc405]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] <== disconnect_volume: return (382ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:09:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Deleting instance files /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c_del
Oct 23 20:09:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Deletion of /opt/stack/data/nova/instances/44034c15-e9c6-466b-959a-534b818bab5c_del complete
Oct 23 20:09:40 user nova-compute[74429]: INFO nova.compute.manager [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Took 2.19 seconds to destroy the instance on the hypervisor.
Oct 23 20:09:40 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c50c2f6-bc23-4f06-b2fb-fcf5dc18448c req-b401359e-d1bb-4ea0-8c71-10538fc18edc service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c50c2f6-bc23-4f06-b2fb-fcf5dc18448c req-b401359e-d1bb-4ea0-8c71-10538fc18edc service nova] Acquiring lock "44034c15-e9c6-466b-959a-534b818bab5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c50c2f6-bc23-4f06-b2fb-fcf5dc18448c req-b401359e-d1bb-4ea0-8c71-10538fc18edc service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c50c2f6-bc23-4f06-b2fb-fcf5dc18448c req-b401359e-d1bb-4ea0-8c71-10538fc18edc service nova] Lock "44034c15-e9c6-466b-959a-534b818bab5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c50c2f6-bc23-4f06-b2fb-fcf5dc18448c req-b401359e-d1bb-4ea0-8c71-10538fc18edc service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] No waiting events found dispatching network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:41 user nova-compute[74429]: WARNING nova.compute.manager [req-9c50c2f6-bc23-4f06-b2fb-fcf5dc18448c req-b401359e-d1bb-4ea0-8c71-10538fc18edc service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received unexpected event network-vif-plugged-a6a5270f-79da-4735-a1f4-5bc0fac5259d for instance with vm_state active and task_state deleting.
Oct 23 20:09:41 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Instance destroyed successfully.
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.objects.instance [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lazy-loading 'resources' on Instance uuid 8a7dae8a-3aba-4576-99a0-9b664ef79192 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-858298132',display_name='tempest-VolumesNegativeTest-instance-858298132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-858298132',id=19,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='466ae17fcb2e4268a3286fd7c6675952',ramdisk_id='',reservation_id='r-873azgcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-938656725',owner_user_name='tempest-VolumesNegativeTest-938656725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:08:00Z,user_data=None,user_id='191e8c37973f410ab676a8d3dd8428df',uuid=8a7dae8a-3aba-4576-99a0-9b664ef79192,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Converting VIF {"id": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "address": "fa:16:3e:92:3b:3a", "network": {"id": "8d0b10d9-75ec-49f8-9b72-3fc61bc0001e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ca447e7883e4fd9902144685af75bd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bb7585-ef", "ovs_interfaceid": "73bb7585-ef1d-4fcd-ba05-78960ec87240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG os_vif [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73bb7585-ef, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30d8e3c2-4ae5-4252-8a2b-0b6ac664fb12) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:41 user nova-compute[74429]: INFO os_vif [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:3b:3a,bridge_name='br-int',has_traffic_filtering=True,id=73bb7585-ef1d-4fcd-ba05-78960ec87240,network=Network(8d0b10d9-75ec-49f8-9b72-3fc61bc0001e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bb7585-ef')
Oct 23 20:09:41 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Deleting instance files /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192_del
Oct 23 20:09:41 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Deletion of /opt/stack/data/nova/instances/8a7dae8a-3aba-4576-99a0-9b664ef79192_del complete
Oct 23 20:09:41 user nova-compute[74429]: INFO nova.compute.manager [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Took 1.67 seconds to destroy the instance on the hypervisor.
Oct 23 20:09:41 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:41 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Took 1.03 seconds to deallocate network for instance.
Oct 23 20:09:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-6b9279fa-48b9-4fe5-b08a-d44192587422 req-52efe804-d8cd-4b4c-a5ff-36f8fe6113a3 service nova] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Received event network-vif-deleted-a6a5270f-79da-4735-a1f4-5bc0fac5259d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:42 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Took 1.08 seconds to deallocate network for instance.
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Acquiring lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] No waiting events found dispatching network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:42 user nova-compute[74429]: WARNING nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received unexpected event network-vif-plugged-73bb7585-ef1d-4fcd-ba05-78960ec87240 for instance with vm_state active and task_state deleting.
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] No waiting events found dispatching network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:42 user nova-compute[74429]: WARNING nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received unexpected event network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 for instance with vm_state building and task_state spawning.
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] No waiting events found dispatching network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:42 user nova-compute[74429]: WARNING nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received unexpected event network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 for instance with vm_state building and task_state spawning.
Oct 23 20:09:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-a67b76bb-d9b5-4680-997e-730c40ce696c req-c23ae74c-e4ba-4fc4-9ba4-92078a88d6cb service nova] [instance: 8a7dae8a-3aba-4576-99a0-9b664ef79192] Received event network-vif-deleted-73bb7585-ef1d-4fcd-ba05-78960ec87240 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:43 user nova-compute[74429]: INFO nova.compute.manager [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] [instance: 44034c15-e9c6-466b-959a-534b818bab5c] Took 1.30 seconds to detach 1 volumes for instance.
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.010s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:43 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Deleted allocations for instance 8a7dae8a-3aba-4576-99a0-9b664ef79192
Oct 23 20:09:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-bfc4e1e3-bf32-4ebe-9f4f-ca7ab6d3b0a9 tempest-VolumesNegativeTest-938656725 tempest-VolumesNegativeTest-938656725-project-member] Lock "8a7dae8a-3aba-4576-99a0-9b664ef79192" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.536s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:09:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Instance spawned successfully.
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:09:43 user nova-compute[74429]: INFO nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Took 7.50 seconds to spawn the instance on the hypervisor.
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:09:43 user nova-compute[74429]: INFO nova.compute.manager [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Took 8.58 seconds to build instance.
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e874e649-3fce-49bf-8642-d718042946a1 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dfa666c7-491b-41e3-8beb-165b4081235f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.760s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:43 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Deleted allocations for instance 44034c15-e9c6-466b-959a-534b818bab5c
Oct 23 20:09:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60de3e47-8baa-4d34-aa63-df275cce3d93 tempest-ServerActionsTestOtherB-1184256079 tempest-ServerActionsTestOtherB-1184256079-project-member] Lock "44034c15-e9c6-466b-959a-534b818bab5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.431s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:09:50 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:09:50 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:09:50 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd4fd3d-300f-43d9-ac27-9fc7636a0b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:09:50 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b0f44b-bb75-447a-8d5b-c2af049bb4d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f] added
Oct 23 20:09:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca8de9-1716-4285-b437-842a0e1da644]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055f2bb-9bba-4f87-ba90-8d14d0883c75]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdUNjmuR {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdUNjmuR" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[97492c56-7046-4957-93c5-055c766fb866]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdUNjmuR'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd007f-fb82-45d2-a813-bc7e9c78927f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2d07f8-8153-4ec3-a098-4959ac8b2d9f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a88e44-9cb3-438a-9fce-332616451b72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]
Oct 23 20:09:50 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.
Oct 23 20:09:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cc3660-1f34-4a42-9bc0-b88d2f0a718b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[053674d1-5eb7-4bc8-bbeb-2025635bd6b2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:09:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:50 user nova-compute[74429]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:09:50 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bde73-b16c-467f-822c-89e664e4b3e7]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:09:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:09:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:09:51 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23936346366336239', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:09:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936346366336239', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:09:51 user nova-compute[74429]: DEBUG nova.objects.instance [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'flavor' on Instance uuid b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:09:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:09:51 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:09:51 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:09:51 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:09:51 user nova-compute[74429]:   <serial>3a5565ff-d242-42c5-91ce-6c81ad7dc70f</serial>
Oct 23 20:09:51 user nova-compute[74429]: </disk>
Oct 23 20:09:51 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No VIF found with MAC fa:16:3e:94:2a:28, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-69a8f27c-9edb-4f8d-93ac-2e88fb58a123 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.102s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "f835ce97-1139-4849-85a8-df51f4b01627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:52 user nova-compute[74429]: INFO nova.compute.manager [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Terminating instance
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-36f79108-a949-42f0-8fe9-d20880a60386 req-ff839484-e355-487d-b6c2-4ef6b765d98a service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-vif-unplugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-36f79108-a949-42f0-8fe9-d20880a60386 req-ff839484-e355-487d-b6c2-4ef6b765d98a service nova] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-36f79108-a949-42f0-8fe9-d20880a60386 req-ff839484-e355-487d-b6c2-4ef6b765d98a service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-36f79108-a949-42f0-8fe9-d20880a60386 req-ff839484-e355-487d-b6c2-4ef6b765d98a service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-36f79108-a949-42f0-8fe9-d20880a60386 req-ff839484-e355-487d-b6c2-4ef6b765d98a service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] No waiting events found dispatching network-vif-unplugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-36f79108-a949-42f0-8fe9-d20880a60386 req-ff839484-e355-487d-b6c2-4ef6b765d98a service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-vif-unplugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:09:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Instance destroyed successfully.
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'resources' on Instance uuid f835ce97-1139-4849-85a8-df51f4b01627 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-877148026',display_name='tempest-VolumesAdminNegativeTest-server-877148026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-877148026',id=18,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:07:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='345690fb675e48679dee09c586df74fe',ramdisk_id='',reservation_id='r-tjgpgsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1432262633',owner_user_name='tempest-VolumesAdminNegativeTest-1432262633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:07:54Z,user_data=None,user_id='7124ed7c57024d3aa751c46d237ecf50',uuid=f835ce97-1139-4849-85a8-df51f4b01627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converting VIF {"id": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "address": "fa:16:3e:62:e3:38", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffa2ce9-d7", "ovs_interfaceid": "affa2ce9-d72d-44c0-b31d-ad5b93b25cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG os_vif [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaffa2ce9-d7, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57a11a96-98e7-4b6b-a192-be9d104971b7) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:53 user nova-compute[74429]: INFO os_vif [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:e3:38,bridge_name='br-int',has_traffic_filtering=True,id=affa2ce9-d72d-44c0-b31d-ad5b93b25cfe,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffa2ce9-d7')
Oct 23 20:09:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Deleting instance files /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627_del
Oct 23 20:09:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Deletion of /opt/stack/data/nova/instances/f835ce97-1139-4849-85a8-df51f4b01627_del complete
Oct 23 20:09:53 user nova-compute[74429]: INFO nova.compute.manager [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Took 0.79 seconds to destroy the instance on the hypervisor.
Oct 23 20:09:53 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: f835ce97-1139-4849-85a8-df51f4b01627] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:09:53 user nova-compute[74429]: INFO nova.compute.manager [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Rebuilding instance
Oct 23 20:09:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:09:54 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Took 0.70 seconds to deallocate network for instance.
Oct 23 20:09:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-1eb1ba1a-2340-4e83-ba65-b0313b5aff4c req-54a47e4f-75bb-442b-b634-437da02d945a service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-vif-deleted-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:09:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:54 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Deleted allocations for instance f835ce97-1139-4849-85a8-df51f4b01627
Oct 23 20:09:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-176ef6cd-ff3e-4100-9707-4d4f23ee6628 tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "f835ce97-1139-4849-85a8-df51f4b01627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance destroyed successfully.
Oct 23 20:09:55 user nova-compute[74429]: INFO nova.compute.manager [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Detaching volume 3a5565ff-d242-42c5-91ce-6c81ad7dc70f
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received event network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Acquiring lock "f835ce97-1139-4849-85a8-df51f4b01627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Lock "f835ce97-1139-4849-85a8-df51f4b01627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] No waiting events found dispatching network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:55 user nova-compute[74429]: WARNING nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: f835ce97-1139-4849-85a8-df51f4b01627] Received unexpected event network-vif-plugged-affa2ce9-d72d-44c0-b31d-ad5b93b25cfe for instance with vm_state deleted and task_state None.
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-unplugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-unplugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:55 user nova-compute[74429]: WARNING nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-unplugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state active and task_state rebuilding.
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:09:55 user nova-compute[74429]: WARNING nova.compute.manager [req-4e0b1425-9ba7-4e31-85b1-c9f6c032384b req-76e7197f-b441-4a12-850e-e34fdace119d service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state active and task_state rebuilding.
Oct 23 20:09:55 user nova-compute[74429]: INFO nova.virt.block_device [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attempting to driver detach volume 3a5565ff-d242-42c5-91ce-6c81ad7dc70f from mountpoint /dev/vdb
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Attempting to detach device vdb from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:09:55 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:09:55 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:09:55 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:09:55 user nova-compute[74429]:   <serial>3a5565ff-d242-42c5-91ce-6c81ad7dc70f</serial>
Oct 23 20:09:55 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:09:55 user nova-compute[74429]: </disk>
Oct 23 20:09:55 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:09:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully detached device vdb from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c from the persistent domain config.
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:09:55 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9419c68e-81aa-492b-bc53-2d4a305594f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:09:55 user nova-compute[74429]: No targets found.
Oct 23 20:09:55 user nova-compute[74429]: iSNS:
Oct 23 20:09:55 user nova-compute[74429]: No targets found.
Oct 23 20:09:55 user nova-compute[74429]: STATIC:
Oct 23 20:09:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:09:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:09:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:09:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8
Oct 23 20:09:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:09:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:09:55 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f
Oct 23 20:09:55 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:09:55 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:09:55 user nova-compute[74429]: FIRMWARE:
Oct 23 20:09:55 user nova-compute[74429]: No targets found.
Oct 23 20:09:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:09:55 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:09:55 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d37956-7d3c-4053-a955-d58620760379]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82988f90-3b90-4a1f-b189-0695dd9db207]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:55 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:55 user nova-compute[74429]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:09:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:09:55 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:09:55 user nova-compute[74429]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:09:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5035c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f5ffbe-9ffe-4bc7-be8d-3d8d4153fc9c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e82a6b-f6bc-4a9a-a0d0-cfe7a373e435]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b16173b-3305-47e9-8270-70cb5be0bf51]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99eb9d-b55f-4f55-a64f-bddab97154c9]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba60ed7-8a08-4514-ac71-c34fc450a8ca]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1548ab-71ca-4d3b-8bab-8160492d6596]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]
Oct 23 20:09:55 user nova-compute[74429]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.
Oct 23 20:09:55 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e79ca21-531e-4566-9765-ffde93d8a10b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== disconnect_volume: return (318ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:09:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:09:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:09:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received event network-changed-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Refreshing instance network info cache due to event network-changed-3787f163-ec13-4032-a8b6-22b3ba8266d0. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] Acquiring lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] Acquired lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.network.neutron [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Refreshing network info cache for port 3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:10:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance destroyed successfully.
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-827890034',display_name='tempest-ServerActionsTestOtherA-server-547736905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-827890034',id=17,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EFIfEvl7T4zhPHVD8bG3YLP7Y2gtAz3vSzwgQmnyjokuMyCUhiDI+u0wB4PLqk+yw5AVHydn/wQ8s3JL0iPGqdCzitvGgcY3aPaoJMI2kBK+hU+fei46Dz8tzhSrFQg==',key_name='tempest-keypair-1147496445',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-lw0j6wag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=b3df83c8-d19c-4eee-b1be-80a2ce516d5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e1f1772-e8, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88ae4da1-5831-4847-9661-6547d4610456) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: INFO nova.compute.manager [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Terminating instance
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:10:04 user nova-compute[74429]: INFO os_vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8')
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:10:04 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[384e1a70-412d-427f-b80e-8879d27e0196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:10:04 user nova-compute[74429]: No targets found.
Oct 23 20:10:04 user nova-compute[74429]: iSNS:
Oct 23 20:10:04 user nova-compute[74429]: No targets found.
Oct 23 20:10:04 user nova-compute[74429]: STATIC:
Oct 23 20:10:04 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:10:04 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:10:04 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:10:04 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8
Oct 23 20:10:04 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:10:04 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:10:04 user nova-compute[74429]: FIRMWARE:
Oct 23 20:10:04 user nova-compute[74429]: No targets found.
Oct 23 20:10:04 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:10:04 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:10:04 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b8e20b-3dae-45a4-82b4-a822e798b8ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49ce1f9-0596-40f9-8f2a-85161b822c79]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:04 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:04 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:04 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:04 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5015d7e0>, {}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Disconnecting from: [] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== disconnect_volume: return (91ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:10:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Deleting instance files /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c_del
Oct 23 20:10:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Deletion of /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c_del complete
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:04 user nova-compute[74429]: INFO nova.virt.block_device [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Booting with volume 3a5565ff-d242-42c5-91ce-6c81ad7dc70f at /dev/vdb
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.utils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5226e48-d7b0-4a1b-af84-b7e5be01b296]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf99b6a4-d83b-44c0-b141-210f5d28e52b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.network.neutron [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updated VIF entry in instance network info cache for port 3787f163-ec13-4032-a8b6-22b3ba8266d0. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.network.neutron [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating instance_info_cache with network_info: [{"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[959ca024-4821-49eb-a9df-b27c48a5a159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2534f7-f139-417e-a387-7a8e7a642f6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-66a0b88c-3219-4ba8-8538-4f5271f09aab req-e3c0e56b-49b6-4107-b3a8-e7c494b4add2 service nova] Releasing lock "refresh_cache-60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:10:04 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:10:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf18f73-96f5-4012-9c61-0817172c9693]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG os_brick.utils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:10:04 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updating existing volume attachment record: 1031682f-4996-4e5c-9c69-20d5637a1d5f {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:10:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Instance destroyed successfully.
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.objects.instance [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lazy-loading 'resources' on Instance uuid 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1404241175',display_name='tempest-TestStampPattern-server-1404241175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1404241175',id=9,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8UEGx8zY0R42EfuCAeeZ9GcoX+fKO6uxcXyPESeKU8tZbyBeoCemxWqY8zrVqk2YCKJ1oYbgTDCWR7zsf+i7gwTf2tIe3iSvwUxABB+ro2StTbFJpgMxD50UDdJ16VlQ==',key_name='tempest-TestStampPattern-310945430',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:01:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74dd7809fa6b4cf185a02e8ffc0f5439',ramdisk_id='',reservation_id='r-1b5jz0ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1617962097',owner_user_name='tempest-TestStampPattern-1617962097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:05:25Z,user_data=None,user_id='c600566c5fef49bdabb57bc0f8233049',uuid=60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converting VIF {"id": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "address": "fa:16:3e:be:cb:dc", "network": {"id": "7d073e85-bedf-47df-b3b1-dfc5316d9ddf", "bridge": "br-int", "label": "tempest-TestStampPattern-1733827545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74dd7809fa6b4cf185a02e8ffc0f5439", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787f163-ec", "ovs_interfaceid": "3787f163-ec13-4032-a8b6-22b3ba8266d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG os_vif [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3787f163-ec, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f6c2114-8998-4ee9-b66e-dbe4759382b8) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:05 user nova-compute[74429]: INFO os_vif [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:cb:dc,bridge_name='br-int',has_traffic_filtering=True,id=3787f163-ec13-4032-a8b6-22b3ba8266d0,network=Network(7d073e85-bedf-47df-b3b1-dfc5316d9ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787f163-ec')
Oct 23 20:10:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Deleting instance files /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853_del
Oct 23 20:10:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Deletion of /opt/stack/data/nova/instances/60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853_del complete
Oct 23 20:10:05 user nova-compute[74429]: INFO nova.compute.manager [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 23 20:10:05 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:05 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Took 0.52 seconds to deallocate network for instance.
Oct 23 20:10:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd1c09e2-a84d-4f3e-927a-299fee5d7166 req-2970cc0b-cc3a-4a96-a5e5-c13a19f0a926 service nova] [instance: 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853] Received event network-vif-deleted-3787f163-ec13-4032-a8b6-22b3ba8266d0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:06 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Deleted allocations for instance 60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853
Oct 23 20:10:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98b58b2a-c0b2-46fc-961f-6adfb5bba817 tempest-TestStampPattern-1617962097 tempest-TestStampPattern-1617962097-project-member] Lock "60ffb8b9-ef3a-4a1a-8e10-a609cbdaf853" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquired lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'info_cache' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:06 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Releasing lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance destroyed successfully.
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'resources' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ec5a03-70, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fcff314-c15f-42be-b55c-2ec30b27c2b9) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:07 user nova-compute[74429]: INFO os_vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70')
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:10:07 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b29a42-a7de-4016-a234-75b3c108f635]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:10:07 user nova-compute[74429]: No targets found.
Oct 23 20:10:07 user nova-compute[74429]: iSNS:
Oct 23 20:10:07 user nova-compute[74429]: No targets found.
Oct 23 20:10:07 user nova-compute[74429]: STATIC:
Oct 23 20:10:07 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:10:07 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:10:07 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:10:07 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8
Oct 23 20:10:07 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:10:07 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:10:07 user nova-compute[74429]: FIRMWARE:
Oct 23 20:10:07 user nova-compute[74429]: No targets found.
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:10:07 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:10:07 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a19c35d-3325-44b1-8020-82c56223534e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55eabb7-1aed-4f84-8769-798691b814d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:07 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:07 user nova-compute[74429]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50753640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ced642-9d5b-4943-afe8-7c4183df609a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce365139-66fb-4238-8e94-39dd27f8d2e1]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef58eb-f626-45c9-8ba6-c7d6237ce425]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f41c27-03b5-452d-bcf6-514ea1d8887c]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9289bba-4424-4a2e-9e9d-0771a0e891f7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d2df01-28ea-4915-b6dd-c39dd9549577]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]
Oct 23 20:10:07 user nova-compute[74429]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[369977cc-9765-4a70-a2f6-30054fd8b3dc]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== disconnect_volume: return (283ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start _get_guest_xml network_info=[{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '3ddf0567-c8f1-4413-bcd1-eb0eb600d085', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '236ad665-9dd8-4cb3-85cd-35f1b6a26b3a', 'attached_at': '', 'detached_at': '', 'volume_id': '42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'serial': '42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'numa_topology' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:07 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'vcpu_model' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:10:07 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:10:07 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:10:07 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a606b1c-e806-426a-81db-b13f88064d55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:10:07 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd60b13d-9d99-4423-b32a-9113098350bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8] added
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b7ef5f-a39c-4cca-9b12-cf0374099ec4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a315e-9155-4fc1-91d7-4f365cd80ac4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msAywLNn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msAywLNn" returned: 0 in 0.039s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf77991-2eaa-4f0e-a484-726895274398]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msAywLNn'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b20ea-96a2-46ed-9016-65496ba1c9eb]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[522acd9e-b9fd-4175-8f81-21993573087d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:07 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:10:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a177f-d4ef-4645-9c0d-2513d48ba2ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]
Oct 23 20:10:08 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.
Oct 23 20:10:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9300a679-9cb0-49e6-aeb3-d11726dd2ad7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e6d25-5699-4ee8-ac41-94704130dfee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:08 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:08 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d39a0b2-6de9-4ca6-bb6c-524b73f72b49]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23532383332653565', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532383332653565', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'pci_devices' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:10:09 user nova-compute[74429]:   <uuid>236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</uuid>
Oct 23 20:10:09 user nova-compute[74429]:   <name>instance-00000010</name>
Oct 23 20:10:09 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:10:09 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:10:09 user nova-compute[74429]:   <metadata>
Oct 23 20:10:09 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:10:09 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:10:09 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeTestJSON-server-2118326004</nova:name>
Oct 23 20:10:09 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:10:07</nova:creationTime>
Oct 23 20:10:09 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:10:09 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:10:09 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:10:09 user nova-compute[74429]:       <nova:owner>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:user uuid="9ce4aa1886f044d3bb7c952632b48047">tempest-AttachVolumeTestJSON-1733625309-project-member</nova:user>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:project uuid="f4121e72c37c4fa5acfd0f568fc1153d">tempest-AttachVolumeTestJSON-1733625309</nova:project>
Oct 23 20:10:09 user nova-compute[74429]:       </nova:owner>
Oct 23 20:10:09 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:10:09 user nova-compute[74429]:       <nova:ports>
Oct 23 20:10:09 user nova-compute[74429]:         <nova:port uuid="d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee">
Oct 23 20:10:09 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:10:09 user nova-compute[74429]:         </nova:port>
Oct 23 20:10:09 user nova-compute[74429]:       </nova:ports>
Oct 23 20:10:09 user nova-compute[74429]:     </nova:instance>
Oct 23 20:10:09 user nova-compute[74429]:   </metadata>
Oct 23 20:10:09 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:10:09 user nova-compute[74429]:     <system>
Oct 23 20:10:09 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:10:09 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:10:09 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:10:09 user nova-compute[74429]:       <entry name="serial">236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</entry>
Oct 23 20:10:09 user nova-compute[74429]:       <entry name="uuid">236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</entry>
Oct 23 20:10:09 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:10:09 user nova-compute[74429]:     </system>
Oct 23 20:10:09 user nova-compute[74429]:   </sysinfo>
Oct 23 20:10:09 user nova-compute[74429]:   <os>
Oct 23 20:10:09 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:10:09 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:10:09 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:10:09 user nova-compute[74429]:   </os>
Oct 23 20:10:09 user nova-compute[74429]:   <features>
Oct 23 20:10:09 user nova-compute[74429]:     <acpi/>
Oct 23 20:10:09 user nova-compute[74429]:     <apic/>
Oct 23 20:10:09 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:10:09 user nova-compute[74429]:   </features>
Oct 23 20:10:09 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:10:09 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:10:09 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:10:09 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:10:09 user nova-compute[74429]:   </clock>
Oct 23 20:10:09 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:10:09 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:10:09 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:10:09 user nova-compute[74429]:   </cpu>
Oct 23 20:10:09 user nova-compute[74429]:   <devices>
Oct 23 20:10:09 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:10:09 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:10:09 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk"/>
Oct 23 20:10:09 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:10:09 user nova-compute[74429]:     </disk>
Oct 23 20:10:09 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:10:09 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:10:09 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:10:09 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:10:09 user nova-compute[74429]:       <serial>42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8</serial>
Oct 23 20:10:09 user nova-compute[74429]:     </disk>
Oct 23 20:10:09 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:10:09 user nova-compute[74429]:       <mac address="fa:16:3e:88:c1:97"/>
Oct 23 20:10:09 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:09 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:10:09 user nova-compute[74429]:       <target dev="tapd0ec5a03-70"/>
Oct 23 20:10:09 user nova-compute[74429]:     </interface>
Oct 23 20:10:09 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:10:09 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/console.log" append="off"/>
Oct 23 20:10:09 user nova-compute[74429]:     </serial>
Oct 23 20:10:09 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:10:09 user nova-compute[74429]:     <video>
Oct 23 20:10:09 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:09 user nova-compute[74429]:     </video>
Oct 23 20:10:09 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:10:09 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:10:09 user nova-compute[74429]:     </rng>
Oct 23 20:10:09 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:10:09 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:10:09 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:10:09 user nova-compute[74429]:     </memballoon>
Oct 23 20:10:09 user nova-compute[74429]:   </devices>
Oct 23 20:10:09 user nova-compute[74429]: </domain>
Oct 23 20:10:09 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'trusted_certs' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Cannot resize image /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'migration_context' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.objects.base [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG os_vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7019e352-a2a1-59a7-9760-30d3412da451', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ec5a03-70, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ec5a03-70, col_values=(('qos', UUID('93940d2e-54a3-49de-b087-faf7823b0090')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ec5a03-70, col_values=(('external_ids', {'iface-id': 'd0ec5a03-7054-4e1a-9b13-cb5b0f5862ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c1:97', 'vm-uuid': '236ad665-9dd8-4cb3-85cd-35f1b6a26b3a'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:10 user nova-compute[74429]: INFO os_vif [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70')
Oct 23 20:10:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-9ad47d4c-fc78-4f81-a993-f4b95e8dfd95 req-841e6347-95a3-44e6-a48e-873bf57332c4 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9ad47d4c-fc78-4f81-a993-f4b95e8dfd95 req-841e6347-95a3-44e6-a48e-873bf57332c4 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9ad47d4c-fc78-4f81-a993-f4b95e8dfd95 req-841e6347-95a3-44e6-a48e-873bf57332c4 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9ad47d4c-fc78-4f81-a993-f4b95e8dfd95 req-841e6347-95a3-44e6-a48e-873bf57332c4 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-9ad47d4c-fc78-4f81-a993-f4b95e8dfd95 req-841e6347-95a3-44e6-a48e-873bf57332c4 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:11 user nova-compute[74429]: WARNING nova.compute.manager [req-9ad47d4c-fc78-4f81-a993-f4b95e8dfd95 req-841e6347-95a3-44e6-a48e-873bf57332c4 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state powering-on.
Oct 23 20:10:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-695b92d0-83e3-423b-bc49-058e86ba6dbc req-9ee151df-c675-44bd-9f61-5a950b2d566c service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-695b92d0-83e3-423b-bc49-058e86ba6dbc req-9ee151df-c675-44bd-9f61-5a950b2d566c service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-695b92d0-83e3-423b-bc49-058e86ba6dbc req-9ee151df-c675-44bd-9f61-5a950b2d566c service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-695b92d0-83e3-423b-bc49-058e86ba6dbc req-9ee151df-c675-44bd-9f61-5a950b2d566c service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-695b92d0-83e3-423b-bc49-058e86ba6dbc req-9ee151df-c675-44bd-9f61-5a950b2d566c service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:13 user nova-compute[74429]: WARNING nova.compute.manager [req-695b92d0-83e3-423b-bc49-058e86ba6dbc req-9ee151df-c675-44bd-9f61-5a950b2d566c service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state powering-on.
Oct 23 20:10:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:10:13 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance rebooted successfully.
Oct 23 20:10:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6823c115-edc2-402a-b4d7-952b8b55e488 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:10:14 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:10:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:10:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:16 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:10:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:10:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:22 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:22 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=25.389511108398438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:22 user nova-compute[74429]: INFO nova.compute.manager [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Rescuing
Oct 23 20:10:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b02494e7-5fd0-4a23-ae27-252fdea795c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dfa666c7-491b-41e3-8beb-165b4081235f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updating instance_info_cache with network_info: [{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:10:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.013s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-2761436c-e700-4c78-819c-0e5412ee0d3d req-950f6afe-3f49-4909-b21a-0dd0957738a2 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-unplugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2761436c-e700-4c78-819c-0e5412ee0d3d req-950f6afe-3f49-4909-b21a-0dd0957738a2 service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2761436c-e700-4c78-819c-0e5412ee0d3d req-950f6afe-3f49-4909-b21a-0dd0957738a2 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2761436c-e700-4c78-819c-0e5412ee0d3d req-950f6afe-3f49-4909-b21a-0dd0957738a2 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-2761436c-e700-4c78-819c-0e5412ee0d3d req-950f6afe-3f49-4909-b21a-0dd0957738a2 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-unplugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:23 user nova-compute[74429]: WARNING nova.compute.manager [req-2761436c-e700-4c78-819c-0e5412ee0d3d req-950f6afe-3f49-4909-b21a-0dd0957738a2 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-unplugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state active and task_state rescuing.
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance destroyed successfully.
Oct 23 20:10:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Attempting rescue
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74429) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:10:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Creating image(s)
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'trusted_certs' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:10:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Creating image(s)
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.216s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue" returned: 0 in 0.062s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'migration_context' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<36eb1960-5d84-4bd7-bf9b-878cfb13196f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Start _get_guest_xml network_info=[{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:f2:75:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'resources' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<36eb1960-5d84-4bd7-bf9b-878cfb13196f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'numa_topology' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<36eb1960-5d84-4bd7-bf9b-878cfb13196f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<36eb1960-5d84-4bd7-bf9b-878cfb13196f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1324301041',display_name='tempest-ServerRescueNegativeTestJSON-server-1324301041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1324301041',id=21,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-2bginkvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:41Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=36eb1960-5d84-4bd7-bf9b-878cfb13196f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:f2:75:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:f2:75:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'pci_devices' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.base [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<36eb1960-5d84-4bd7-bf9b-878cfb13196f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:10:24 user nova-compute[74429]:   <uuid>36eb1960-5d84-4bd7-bf9b-878cfb13196f</uuid>
Oct 23 20:10:24 user nova-compute[74429]:   <name>instance-00000015</name>
Oct 23 20:10:24 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:10:24 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:10:24 user nova-compute[74429]:   <metadata>
Oct 23 20:10:24 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:10:24 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:10:24 user nova-compute[74429]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1324301041</nova:name>
Oct 23 20:10:24 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:10:24</nova:creationTime>
Oct 23 20:10:24 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:10:24 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:10:24 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:10:24 user nova-compute[74429]:       <nova:owner>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:user uuid="c660b1cec6dd476aa14a3d0fb74ebd4a">tempest-ServerRescueNegativeTestJSON-1224059578-project-member</nova:user>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:project uuid="9dbb9beb49ad42fbaf6d07c88babe563">tempest-ServerRescueNegativeTestJSON-1224059578</nova:project>
Oct 23 20:10:24 user nova-compute[74429]:       </nova:owner>
Oct 23 20:10:24 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:10:24 user nova-compute[74429]:       <nova:ports>
Oct 23 20:10:24 user nova-compute[74429]:         <nova:port uuid="ff08b5cd-ef87-48a7-b09c-22b7adc1a88c">
Oct 23 20:10:24 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:10:24 user nova-compute[74429]:         </nova:port>
Oct 23 20:10:24 user nova-compute[74429]:       </nova:ports>
Oct 23 20:10:24 user nova-compute[74429]:     </nova:instance>
Oct 23 20:10:24 user nova-compute[74429]:   </metadata>
Oct 23 20:10:24 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:10:24 user nova-compute[74429]:     <system>
Oct 23 20:10:24 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:10:24 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:10:24 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:10:24 user nova-compute[74429]:       <entry name="serial">36eb1960-5d84-4bd7-bf9b-878cfb13196f</entry>
Oct 23 20:10:24 user nova-compute[74429]:       <entry name="uuid">36eb1960-5d84-4bd7-bf9b-878cfb13196f</entry>
Oct 23 20:10:24 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:10:24 user nova-compute[74429]:     </system>
Oct 23 20:10:24 user nova-compute[74429]:   </sysinfo>
Oct 23 20:10:24 user nova-compute[74429]:   <os>
Oct 23 20:10:24 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:10:24 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:10:24 user nova-compute[74429]:   </os>
Oct 23 20:10:24 user nova-compute[74429]:   <features>
Oct 23 20:10:24 user nova-compute[74429]:     <acpi/>
Oct 23 20:10:24 user nova-compute[74429]:     <apic/>
Oct 23 20:10:24 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:10:24 user nova-compute[74429]:   </features>
Oct 23 20:10:24 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:10:24 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:10:24 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:10:24 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:10:24 user nova-compute[74429]:   </clock>
Oct 23 20:10:24 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:10:24 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:10:24 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:10:24 user nova-compute[74429]:   </cpu>
Oct 23 20:10:24 user nova-compute[74429]:   <devices>
Oct 23 20:10:24 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:10:24 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:10:24 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue"/>
Oct 23 20:10:24 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:10:24 user nova-compute[74429]:     </disk>
Oct 23 20:10:24 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:10:24 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:10:24 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk"/>
Oct 23 20:10:24 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:10:24 user nova-compute[74429]:     </disk>
Oct 23 20:10:24 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:10:24 user nova-compute[74429]:       <mac address="fa:16:3e:f2:75:2a"/>
Oct 23 20:10:24 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:24 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:10:24 user nova-compute[74429]:       <target dev="tapff08b5cd-ef"/>
Oct 23 20:10:24 user nova-compute[74429]:     </interface>
Oct 23 20:10:24 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:10:24 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/console.log" append="off"/>
Oct 23 20:10:24 user nova-compute[74429]:     </serial>
Oct 23 20:10:24 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:10:24 user nova-compute[74429]:     <video>
Oct 23 20:10:24 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:24 user nova-compute[74429]:     </video>
Oct 23 20:10:24 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:10:24 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:10:24 user nova-compute[74429]:     </rng>
Oct 23 20:10:24 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:10:24 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:10:24 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:10:24 user nova-compute[74429]:     </memballoon>
Oct 23 20:10:24 user nova-compute[74429]:   </devices>
Oct 23 20:10:24 user nova-compute[74429]: </domain>
Oct 23 20:10:24 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:10:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance destroyed successfully.
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk 1073741824" returned: 0 in 0.055s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:f2:75:2a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.258s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Cannot resize image /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Ensure instance console log exists: /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Start _get_guest_xml network_info=[{"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '1031682f-4996-4e5c-9c69-20d5637a1d5f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3df83c8-d19c-4eee-b1be-80a2ce516d5c', 'attached_at': '', 'detached_at': '', 'volume_id': '3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'serial': '3a5565ff-d242-42c5-91ce-6c81ad7dc70f'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:10:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 20:10:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:10:24 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:10:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:10:24 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 20:10:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:10:24 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544f335-e3e7-48af-8af6-9abf9aeef4b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:10:24 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba344c-338d-4647-b3ec-5c974d7865e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f] added
Oct 23 20:10:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[35952214-7a10-4b2c-beac-7c1c7bd2062a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b32404a-7fe6-48c0-9d7b-7dd78f7e3d77]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdUNjmuR {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdUNjmuR" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f34b52b-58fd-4f15-80ab-9bdabb2e42f6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdUNjmuR'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3cb18-d0f4-4e08-9db4-07514afc7a4a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35da0a-a71f-4d6d-9612-a2ee92178e8e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4767a1b-3ca7-4f91-8117-a5d1a6e161a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]
Oct 23 20:10:25 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.
Oct 23 20:10:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4171b87c-5da3-4e1f-8ca1-59aae734361e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0bc92-a3f2-4320-be14-e9b06f21b34f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:10:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:10:25 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:10:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8ff886-79f5-416d-81a7-589ba453c6ad]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-43e523d0-4015-4459-be74-ed94de96528e req-915e055b-ac4b-4076-aa94-3ea236b3d110 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-43e523d0-4015-4459-be74-ed94de96528e req-915e055b-ac4b-4076-aa94-3ea236b3d110 service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-43e523d0-4015-4459-be74-ed94de96528e req-915e055b-ac4b-4076-aa94-3ea236b3d110 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-43e523d0-4015-4459-be74-ed94de96528e req-915e055b-ac4b-4076-aa94-3ea236b3d110 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-43e523d0-4015-4459-be74-ed94de96528e req-915e055b-ac4b-4076-aa94-3ea236b3d110 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:25 user nova-compute[74429]: WARNING nova.compute.manager [req-43e523d0-4015-4459-be74-ed94de96528e req-915e055b-ac4b-4076-aa94-3ea236b3d110 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state active and task_state rescuing.
Oct 23 20:10:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23936346366336239', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936346366336239', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-827890034',display_name='tempest-ServerActionsTestOtherA-server-547736905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-827890034',id=17,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EFIfEvl7T4zhPHVD8bG3YLP7Y2gtAz3vSzwgQmnyjokuMyCUhiDI+u0wB4PLqk+yw5AVHydn/wQ8s3JL0iPGqdCzitvGgcY3aPaoJMI2kBK+hU+fei46Dz8tzhSrFQg==',key_name='tempest-keypair-1147496445',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-lw0j6wag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=b3df83c8-d19c-4eee-b1be-80a2ce516d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:10:26 user nova-compute[74429]:   <uuid>b3df83c8-d19c-4eee-b1be-80a2ce516d5c</uuid>
Oct 23 20:10:26 user nova-compute[74429]:   <name>instance-00000011</name>
Oct 23 20:10:26 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:10:26 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:10:26 user nova-compute[74429]:   <metadata>
Oct 23 20:10:26 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:10:26 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:10:26 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherA-server-547736905</nova:name>
Oct 23 20:10:26 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:10:24</nova:creationTime>
Oct 23 20:10:26 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:10:26 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:10:26 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:10:26 user nova-compute[74429]:       <nova:owner>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:user uuid="80ac3c2700c2447993ba5a8e14db0aa5">tempest-ServerActionsTestOtherA-1925715908-project-member</nova:user>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:project uuid="3f8768b24d954f5cbb03c242e6a3a1f1">tempest-ServerActionsTestOtherA-1925715908</nova:project>
Oct 23 20:10:26 user nova-compute[74429]:       </nova:owner>
Oct 23 20:10:26 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:10:26 user nova-compute[74429]:       <nova:ports>
Oct 23 20:10:26 user nova-compute[74429]:         <nova:port uuid="7e1f1772-e866-4eda-a7aa-d62a94d9f560">
Oct 23 20:10:26 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 20:10:26 user nova-compute[74429]:         </nova:port>
Oct 23 20:10:26 user nova-compute[74429]:       </nova:ports>
Oct 23 20:10:26 user nova-compute[74429]:     </nova:instance>
Oct 23 20:10:26 user nova-compute[74429]:   </metadata>
Oct 23 20:10:26 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:10:26 user nova-compute[74429]:     <system>
Oct 23 20:10:26 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:10:26 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:10:26 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:10:26 user nova-compute[74429]:       <entry name="serial">b3df83c8-d19c-4eee-b1be-80a2ce516d5c</entry>
Oct 23 20:10:26 user nova-compute[74429]:       <entry name="uuid">b3df83c8-d19c-4eee-b1be-80a2ce516d5c</entry>
Oct 23 20:10:26 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:10:26 user nova-compute[74429]:     </system>
Oct 23 20:10:26 user nova-compute[74429]:   </sysinfo>
Oct 23 20:10:26 user nova-compute[74429]:   <os>
Oct 23 20:10:26 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:10:26 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:10:26 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:10:26 user nova-compute[74429]:   </os>
Oct 23 20:10:26 user nova-compute[74429]:   <features>
Oct 23 20:10:26 user nova-compute[74429]:     <acpi/>
Oct 23 20:10:26 user nova-compute[74429]:     <apic/>
Oct 23 20:10:26 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:10:26 user nova-compute[74429]:   </features>
Oct 23 20:10:26 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:10:26 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:10:26 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:10:26 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:10:26 user nova-compute[74429]:   </clock>
Oct 23 20:10:26 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:10:26 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:10:26 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:10:26 user nova-compute[74429]:   </cpu>
Oct 23 20:10:26 user nova-compute[74429]:   <devices>
Oct 23 20:10:26 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:10:26 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:10:26 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk"/>
Oct 23 20:10:26 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:10:26 user nova-compute[74429]:     </disk>
Oct 23 20:10:26 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:10:26 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:10:26 user nova-compute[74429]:       <source dev="/dev/sdc"/>
Oct 23 20:10:26 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:10:26 user nova-compute[74429]:       <serial>3a5565ff-d242-42c5-91ce-6c81ad7dc70f</serial>
Oct 23 20:10:26 user nova-compute[74429]:     </disk>
Oct 23 20:10:26 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:10:26 user nova-compute[74429]:       <mac address="fa:16:3e:94:2a:28"/>
Oct 23 20:10:26 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:26 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:10:26 user nova-compute[74429]:       <target dev="tap7e1f1772-e8"/>
Oct 23 20:10:26 user nova-compute[74429]:     </interface>
Oct 23 20:10:26 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:10:26 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/console.log" append="off"/>
Oct 23 20:10:26 user nova-compute[74429]:     </serial>
Oct 23 20:10:26 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:10:26 user nova-compute[74429]:     <video>
Oct 23 20:10:26 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:26 user nova-compute[74429]:     </video>
Oct 23 20:10:26 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:10:26 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:10:26 user nova-compute[74429]:     </rng>
Oct 23 20:10:26 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:10:26 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:10:26 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:10:26 user nova-compute[74429]:     </memballoon>
Oct 23 20:10:26 user nova-compute[74429]:   </devices>
Oct 23 20:10:26 user nova-compute[74429]: </domain>
Oct 23 20:10:26 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-827890034',display_name='tempest-ServerActionsTestOtherA-server-547736905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-827890034',id=17,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EFIfEvl7T4zhPHVD8bG3YLP7Y2gtAz3vSzwgQmnyjokuMyCUhiDI+u0wB4PLqk+yw5AVHydn/wQ8s3JL0iPGqdCzitvGgcY3aPaoJMI2kBK+hU+fei46Dz8tzhSrFQg==',key_name='tempest-keypair-1147496445',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-lw0j6wag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=b3df83c8-d19c-4eee-b1be-80a2ce516d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG os_vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86e8a716-75b1-568d-9802-65a2e1abcfaa', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e1f1772-e8, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e1f1772-e8, col_values=(('qos', UUID('90f3deb8-5366-4239-9620-f572f9d3521b')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e1f1772-e8, col_values=(('external_ids', {'iface-id': '7e1f1772-e866-4eda-a7aa-d62a94d9f560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:2a:28', 'vm-uuid': 'b3df83c8-d19c-4eee-b1be-80a2ce516d5c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:26 user nova-compute[74429]: INFO os_vif [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8')
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:10:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No VIF found with MAC fa:16:3e:94:2a:28, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:10:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:10:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:10:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d8cc15fb-6169-4139-bb65-0de638302e87 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:10:28 user nova-compute[74429]: INFO nova.compute.claims [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Claim successful on node user
Oct 23 20:10:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.476s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:10:29 user nova-compute[74429]: INFO nova.compute.claims [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Claim successful on node user
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:10:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.policy [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '213b96dfb6b043aabcebdd6710ae8f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35bb75b1bd846e6ac415aaefd410621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:10:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Creating image(s)
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.207s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk 1073741824" returned: 0 in 0.064s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance spawned successfully.
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:10:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.policy [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da9987f7f5024cb2b0094f1efd8fc942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a64891d474410aacce30e403d2f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:10:30 user nova-compute[74429]: INFO nova.virt.block_device [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Booting with volume 70ef0a13-d89b-44f4-822b-1cd41dadc596 at /dev/vda
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.objects.instance [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74429) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Successfully created port: 7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-003ebac4-40ce-400a-b674-338976177b4d tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG os_brick.utils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Cannot resize image /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Ensure instance console log exists: /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[16065ea5-044e-4f8f-941a-aa56c3780676]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[259cac2c-9203-41e8-97b9-e8ea0b4ab676]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[503acbb3-947d-4c75-9708-103f087b4bae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8a1558-4766-463d-acd9-cb7ee0a9c613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:10:30 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:10:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634bb59-1158-4787-a757-9d0a1f6b096c]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG os_brick.utils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:10:30 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating existing volume attachment record: 57c2240a-87b3-4bea-a813-0079951a7640 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Successfully created port: fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Successfully updated port: 7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing instance network info cache due to event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance network_info: |[{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Start _get_guest_xml network_info=[{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:10:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-484815685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-484815685',id=24,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIhi7GEHDm9o+sD3rEkCWx650rr/AtW//YwSwASR0/JSk98CdjaUsTSUGFMNwA5wN8lur+M/btid/agHB9nMoAuQU3xIB4GLFaeid2O7TMdil3U3nKW+txvk0hJjaH0fQ==',key_name='tempest-keypair-383380181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-xfgweb4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=de91660d-61a1-4e58-a75d-8fed5386b6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'pci_devices' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:10:31 user nova-compute[74429]:   <uuid>de91660d-61a1-4e58-a75d-8fed5386b6de</uuid>
Oct 23 20:10:31 user nova-compute[74429]:   <name>instance-00000018</name>
Oct 23 20:10:31 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:10:31 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:10:31 user nova-compute[74429]:   <metadata>
Oct 23 20:10:31 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:10:31 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:10:31 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-484815685</nova:name>
Oct 23 20:10:31 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:10:31</nova:creationTime>
Oct 23 20:10:31 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:10:31 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:10:31 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:10:31 user nova-compute[74429]:       <nova:owner>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:user uuid="213b96dfb6b043aabcebdd6710ae8f4c">tempest-AttachVolumeShelveTestJSON-301170821-project-member</nova:user>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:project uuid="e35bb75b1bd846e6ac415aaefd410621">tempest-AttachVolumeShelveTestJSON-301170821</nova:project>
Oct 23 20:10:31 user nova-compute[74429]:       </nova:owner>
Oct 23 20:10:31 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:10:31 user nova-compute[74429]:       <nova:ports>
Oct 23 20:10:31 user nova-compute[74429]:         <nova:port uuid="7a399db8-c2da-4bd4-84a1-37a1155a1912">
Oct 23 20:10:31 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:10:31 user nova-compute[74429]:         </nova:port>
Oct 23 20:10:31 user nova-compute[74429]:       </nova:ports>
Oct 23 20:10:31 user nova-compute[74429]:     </nova:instance>
Oct 23 20:10:31 user nova-compute[74429]:   </metadata>
Oct 23 20:10:31 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:10:31 user nova-compute[74429]:     <system>
Oct 23 20:10:31 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:10:31 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:10:31 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:10:31 user nova-compute[74429]:       <entry name="serial">de91660d-61a1-4e58-a75d-8fed5386b6de</entry>
Oct 23 20:10:31 user nova-compute[74429]:       <entry name="uuid">de91660d-61a1-4e58-a75d-8fed5386b6de</entry>
Oct 23 20:10:31 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:10:31 user nova-compute[74429]:     </system>
Oct 23 20:10:31 user nova-compute[74429]:   </sysinfo>
Oct 23 20:10:31 user nova-compute[74429]:   <os>
Oct 23 20:10:31 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:10:31 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:10:31 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:10:31 user nova-compute[74429]:   </os>
Oct 23 20:10:31 user nova-compute[74429]:   <features>
Oct 23 20:10:31 user nova-compute[74429]:     <acpi/>
Oct 23 20:10:31 user nova-compute[74429]:     <apic/>
Oct 23 20:10:31 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:10:31 user nova-compute[74429]:   </features>
Oct 23 20:10:31 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:10:31 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:10:31 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:10:31 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:10:31 user nova-compute[74429]:   </clock>
Oct 23 20:10:31 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:10:31 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:10:31 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:10:31 user nova-compute[74429]:   </cpu>
Oct 23 20:10:31 user nova-compute[74429]:   <devices>
Oct 23 20:10:31 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:10:31 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:10:31 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk"/>
Oct 23 20:10:31 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:10:31 user nova-compute[74429]:     </disk>
Oct 23 20:10:31 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:10:31 user nova-compute[74429]:       <mac address="fa:16:3e:16:e2:c8"/>
Oct 23 20:10:31 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:31 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:10:31 user nova-compute[74429]:       <target dev="tap7a399db8-c2"/>
Oct 23 20:10:31 user nova-compute[74429]:     </interface>
Oct 23 20:10:31 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:10:31 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/console.log" append="off"/>
Oct 23 20:10:31 user nova-compute[74429]:     </serial>
Oct 23 20:10:31 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:10:31 user nova-compute[74429]:     <video>
Oct 23 20:10:31 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:31 user nova-compute[74429]:     </video>
Oct 23 20:10:31 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:10:31 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:10:31 user nova-compute[74429]:     </rng>
Oct 23 20:10:31 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:10:31 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:10:31 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:10:31 user nova-compute[74429]:     </memballoon>
Oct 23 20:10:31 user nova-compute[74429]:   </devices>
Oct 23 20:10:31 user nova-compute[74429]: </domain>
Oct 23 20:10:31 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-484815685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-484815685',id=24,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIhi7GEHDm9o+sD3rEkCWx650rr/AtW//YwSwASR0/JSk98CdjaUsTSUGFMNwA5wN8lur+M/btid/agHB9nMoAuQU3xIB4GLFaeid2O7TMdil3U3nKW+txvk0hJjaH0fQ==',key_name='tempest-keypair-383380181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-xfgweb4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=de91660d-61a1-4e58-a75d-8fed5386b6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG os_vif [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff382fb9-d0d1-5c38-8bfe-766346bcdd70', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a399db8-c2, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a399db8-c2, col_values=(('qos', UUID('2945d7ba-558a-4574-ac35-a8324239e749')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a399db8-c2, col_values=(('external_ids', {'iface-id': '7a399db8-c2da-4bd4-84a1-37a1155a1912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:e2:c8', 'vm-uuid': 'de91660d-61a1-4e58-a75d-8fed5386b6de'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Successfully updated port: fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:31 user nova-compute[74429]: INFO os_vif [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2')
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-changed-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing instance network info cache due to event network-changed-fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:10:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No VIF found with MAC fa:16:3e:16:e2:c8, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-99bd8726-e8fc-4f7e-b932-a23b66b64e73 req-9e510f2c-7f76-43cb-9ff1-1df19748339b service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-99bd8726-e8fc-4f7e-b932-a23b66b64e73 req-9e510f2c-7f76-43cb-9ff1-1df19748339b service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-99bd8726-e8fc-4f7e-b932-a23b66b64e73 req-9e510f2c-7f76-43cb-9ff1-1df19748339b service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-99bd8726-e8fc-4f7e-b932-a23b66b64e73 req-9e510f2c-7f76-43cb-9ff1-1df19748339b service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-99bd8726-e8fc-4f7e-b932-a23b66b64e73 req-9e510f2c-7f76-43cb-9ff1-1df19748339b service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:32 user nova-compute[74429]: WARNING nova.compute.manager [req-99bd8726-e8fc-4f7e-b932-a23b66b64e73 req-9e510f2c-7f76-43cb-9ff1-1df19748339b service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state rescued and task_state None.
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updated VIF entry in instance network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c46f4e5d-d603-4344-ae62-f64285440b3f req-70592583-d152-4e71-9edb-3961a60836da service nova] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance network_info: |[{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing network info cache for port fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updated VIF entry in instance network info cache for port fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e6886439-2e95-4b53-93db-13f505682e78 req-873d6d64-90ec-4653-8644-3902d6e656f6 service nova] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:34 user nova-compute[74429]: WARNING nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state rescued and task_state None.
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:34 user nova-compute[74429]: WARNING nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state active and task_state None.
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:34 user nova-compute[74429]: WARNING nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state active and task_state None.
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:34 user nova-compute[74429]: WARNING nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state building and task_state spawning.
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:34 user nova-compute[74429]: WARNING nova.compute.manager [req-58858c20-d4e2-4537-b29f-edd9b9d18e5f req-c2ef1bb5-e0b7-48c2-ad5d-3db3f0293abb service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state building and task_state spawning.
Oct 23 20:10:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:10:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance spawned successfully.
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:10:36 user nova-compute[74429]: INFO nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Took 6.43 seconds to spawn the instance on the hypervisor.
Oct 23 20:10:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:10:36 user nova-compute[74429]: INFO nova.compute.manager [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Took 7.40 seconds to build instance.
Oct 23 20:10:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8140d92-f1d0-4d36-b47b-3af409554c31 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.518s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:53 user nova-compute[74429]: INFO nova.compute.manager [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Terminating instance
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-a047da54-4e6d-419d-b908-aba8e8610b85 req-3d78bf41-00e6-47cb-825f-8318b58dc861 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-vif-unplugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a047da54-4e6d-419d-b908-aba8e8610b85 req-3d78bf41-00e6-47cb-825f-8318b58dc861 service nova] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a047da54-4e6d-419d-b908-aba8e8610b85 req-3d78bf41-00e6-47cb-825f-8318b58dc861 service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a047da54-4e6d-419d-b908-aba8e8610b85 req-3d78bf41-00e6-47cb-825f-8318b58dc861 service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-a047da54-4e6d-419d-b908-aba8e8610b85 req-3d78bf41-00e6-47cb-825f-8318b58dc861 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] No waiting events found dispatching network-vif-unplugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-a047da54-4e6d-419d-b908-aba8e8610b85 req-3d78bf41-00e6-47cb-825f-8318b58dc861 service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-vif-unplugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:10:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Instance destroyed successfully.
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lazy-loading 'resources' on Instance uuid b02494e7-5fd0-4a23-ae27-252fdea795c9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1391600354',display_name='tempest-VolumesAdminNegativeTest-server-1391600354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1391600354',id=13,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl38gv9fGboKk+E8VXXB7JKDEXxADBOAIlknNe36vgGYvJBU+G/1jVqABn0aRINtebMjEisvqpiRd5jHQ8TRejkSEmlMgrPzG6FomRJdxl5xMxRcVI66viAnXK6nqz/dA==',key_name='tempest-keypair-1202165770',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:04:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='345690fb675e48679dee09c586df74fe',ramdisk_id='',reservation_id='r-ys5vn7q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1432262633',owner_user_name='tempest-VolumesAdminNegativeTest-1432262633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7124ed7c57024d3aa751c46d237ecf50',uuid=b02494e7-5fd0-4a23-ae27-252fdea795c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converting VIF {"id": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "address": "fa:16:3e:c1:b2:41", "network": {"id": "cc3e028c-efb9-4aca-832e-40781f40f330", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-169838936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "345690fb675e48679dee09c586df74fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap588bcb4d-f1", "ovs_interfaceid": "588bcb4d-f13f-4c62-ab1f-e8e7b970f95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG os_vif [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap588bcb4d-f1, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:10:53 user nova-compute[74429]: INFO nova.compute.claims [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Claim successful on node user
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c447a3c-52f1-4c34-9a74-d73a3a5b170c) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:53 user nova-compute[74429]: INFO os_vif [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b2:41,bridge_name='br-int',has_traffic_filtering=True,id=588bcb4d-f13f-4c62-ab1f-e8e7b970f95f,network=Network(cc3e028c-efb9-4aca-832e-40781f40f330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap588bcb4d-f1')
Oct 23 20:10:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Deleting instance files /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9_del
Oct 23 20:10:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Deletion of /opt/stack/data/nova/instances/b02494e7-5fd0-4a23-ae27-252fdea795c9_del complete
Oct 23 20:10:53 user nova-compute[74429]: INFO nova.compute.manager [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 23 20:10:53 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:10:53 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:10:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.policy [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6161756c0a9a4f6ba7a319801ba19818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f5bd02ac3b49d8b904b56e2e89eeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:10:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Creating image(s)
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "/opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "/opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "/opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:54 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Took 0.83 seconds to deallocate network for instance.
Oct 23 20:10:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-dad0fa0b-8cdd-47a3-a274-6df1ab37e6eb req-f3669dc5-5508-4fb4-a6b7-8459a16d9ddc service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-vif-deleted-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.233s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk 1073741824" returned: 0 in 0.061s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Successfully created port: 24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.226s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-d0e85759-2c9d-4cfa-ac5d-647eaa6e35b6 req-aa8795e8-f17a-4c75-a92d-587fd8fdeb0a service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received event network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d0e85759-2c9d-4cfa-ac5d-647eaa6e35b6 req-aa8795e8-f17a-4c75-a92d-587fd8fdeb0a service nova] Acquiring lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d0e85759-2c9d-4cfa-ac5d-647eaa6e35b6 req-aa8795e8-f17a-4c75-a92d-587fd8fdeb0a service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d0e85759-2c9d-4cfa-ac5d-647eaa6e35b6 req-aa8795e8-f17a-4c75-a92d-587fd8fdeb0a service nova] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-d0e85759-2c9d-4cfa-ac5d-647eaa6e35b6 req-aa8795e8-f17a-4c75-a92d-587fd8fdeb0a service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] No waiting events found dispatching network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:55 user nova-compute[74429]: WARNING nova.compute.manager [req-d0e85759-2c9d-4cfa-ac5d-647eaa6e35b6 req-aa8795e8-f17a-4c75-a92d-587fd8fdeb0a service nova] [instance: b02494e7-5fd0-4a23-ae27-252fdea795c9] Received unexpected event network-vif-plugged-588bcb4d-f13f-4c62-ab1f-e8e7b970f95f for instance with vm_state deleted and task_state None.
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Cannot resize image /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Ensure instance console log exists: /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:55 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Deleted allocations for instance b02494e7-5fd0-4a23-ae27-252fdea795c9
Oct 23 20:10:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ef566590-d2a6-4439-879d-79044e9420ad tempest-VolumesAdminNegativeTest-1432262633 tempest-VolumesAdminNegativeTest-1432262633-project-member] Lock "b02494e7-5fd0-4a23-ae27-252fdea795c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.691s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Successfully updated port: 24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquired lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Updating instance_info_cache with network_info: [{"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Releasing lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Instance network_info: |[{"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Start _get_guest_xml network_info=[{"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:10:56 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:56 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1745532892',display_name='tempest-ServersNegativeTestJSON-server-1745532892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1745532892',id=25,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7f5bd02ac3b49d8b904b56e2e89eeef',ramdisk_id='',reservation_id='r-00zjo7wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-254346405',owner_user_name='tempest-ServersNegativeTestJSON-254346405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:55Z,user_data=None,user_id='6161756c0a9a4f6ba7a319801ba19818',uuid=bea3939d-9184-4ca5-aa4a-dba0a1be6af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converting VIF {"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lazy-loading 'pci_devices' on Instance uuid bea3939d-9184-4ca5-aa4a-dba0a1be6af8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:10:56 user nova-compute[74429]:   <uuid>bea3939d-9184-4ca5-aa4a-dba0a1be6af8</uuid>
Oct 23 20:10:56 user nova-compute[74429]:   <name>instance-00000019</name>
Oct 23 20:10:56 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:10:56 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:10:56 user nova-compute[74429]:   <metadata>
Oct 23 20:10:56 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:10:56 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:10:56 user nova-compute[74429]:       <nova:name>tempest-ServersNegativeTestJSON-server-1745532892</nova:name>
Oct 23 20:10:56 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:10:56</nova:creationTime>
Oct 23 20:10:56 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:10:56 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:10:56 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:10:56 user nova-compute[74429]:       <nova:owner>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:user uuid="6161756c0a9a4f6ba7a319801ba19818">tempest-ServersNegativeTestJSON-254346405-project-member</nova:user>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:project uuid="b7f5bd02ac3b49d8b904b56e2e89eeef">tempest-ServersNegativeTestJSON-254346405</nova:project>
Oct 23 20:10:56 user nova-compute[74429]:       </nova:owner>
Oct 23 20:10:56 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:10:56 user nova-compute[74429]:       <nova:ports>
Oct 23 20:10:56 user nova-compute[74429]:         <nova:port uuid="24baabeb-ca1f-4c34-91e8-282d5a79f37d">
Oct 23 20:10:56 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:10:56 user nova-compute[74429]:         </nova:port>
Oct 23 20:10:56 user nova-compute[74429]:       </nova:ports>
Oct 23 20:10:56 user nova-compute[74429]:     </nova:instance>
Oct 23 20:10:56 user nova-compute[74429]:   </metadata>
Oct 23 20:10:56 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:10:56 user nova-compute[74429]:     <system>
Oct 23 20:10:56 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:10:56 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:10:56 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:10:56 user nova-compute[74429]:       <entry name="serial">bea3939d-9184-4ca5-aa4a-dba0a1be6af8</entry>
Oct 23 20:10:56 user nova-compute[74429]:       <entry name="uuid">bea3939d-9184-4ca5-aa4a-dba0a1be6af8</entry>
Oct 23 20:10:56 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:10:56 user nova-compute[74429]:     </system>
Oct 23 20:10:56 user nova-compute[74429]:   </sysinfo>
Oct 23 20:10:56 user nova-compute[74429]:   <os>
Oct 23 20:10:56 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:10:56 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:10:56 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:10:56 user nova-compute[74429]:   </os>
Oct 23 20:10:56 user nova-compute[74429]:   <features>
Oct 23 20:10:56 user nova-compute[74429]:     <acpi/>
Oct 23 20:10:56 user nova-compute[74429]:     <apic/>
Oct 23 20:10:56 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:10:56 user nova-compute[74429]:   </features>
Oct 23 20:10:56 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:10:56 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:10:56 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:10:56 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:10:56 user nova-compute[74429]:   </clock>
Oct 23 20:10:56 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:10:56 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:10:56 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:10:56 user nova-compute[74429]:   </cpu>
Oct 23 20:10:56 user nova-compute[74429]:   <devices>
Oct 23 20:10:56 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:10:56 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:10:56 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk"/>
Oct 23 20:10:56 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:10:56 user nova-compute[74429]:     </disk>
Oct 23 20:10:56 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:10:56 user nova-compute[74429]:       <mac address="fa:16:3e:24:4a:a8"/>
Oct 23 20:10:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:56 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:10:56 user nova-compute[74429]:       <target dev="tap24baabeb-ca"/>
Oct 23 20:10:56 user nova-compute[74429]:     </interface>
Oct 23 20:10:56 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:10:56 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/console.log" append="off"/>
Oct 23 20:10:56 user nova-compute[74429]:     </serial>
Oct 23 20:10:56 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:10:56 user nova-compute[74429]:     <video>
Oct 23 20:10:56 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:10:56 user nova-compute[74429]:     </video>
Oct 23 20:10:56 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:10:56 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:10:56 user nova-compute[74429]:     </rng>
Oct 23 20:10:56 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:10:56 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:10:56 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:10:56 user nova-compute[74429]:     </memballoon>
Oct 23 20:10:56 user nova-compute[74429]:   </devices>
Oct 23 20:10:56 user nova-compute[74429]: </domain>
Oct 23 20:10:56 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1745532892',display_name='tempest-ServersNegativeTestJSON-server-1745532892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1745532892',id=25,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7f5bd02ac3b49d8b904b56e2e89eeef',ramdisk_id='',reservation_id='r-00zjo7wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-254346405',owner_user_name='tempest-ServersNegativeTestJSON-254346405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:55Z,user_data=None,user_id='6161756c0a9a4f6ba7a319801ba19818',uuid=bea3939d-9184-4ca5-aa4a-dba0a1be6af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converting VIF {"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG os_vif [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71000229-ebc1-5c50-b060-6d7cf63411a7', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24baabeb-ca, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24baabeb-ca, col_values=(('qos', UUID('d4692344-442d-49e7-8874-65d04bdbcb90')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24baabeb-ca, col_values=(('external_ids', {'iface-id': '24baabeb-ca1f-4c34-91e8-282d5a79f37d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:4a:a8', 'vm-uuid': 'bea3939d-9184-4ca5-aa4a-dba0a1be6af8'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:56 user nova-compute[74429]: INFO os_vif [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca')
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:10:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] No VIF found with MAC fa:16:3e:24:4a:a8, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-changed-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Refreshing instance network info cache due to event network-changed-24baabeb-ca1f-4c34-91e8-282d5a79f37d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] Acquiring lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] Acquired lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Refreshing network info cache for port 24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Updated VIF entry in instance network info cache for port 24baabeb-ca1f-4c34-91e8-282d5a79f37d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Updating instance_info_cache with network_info: [{"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:10:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-588620f0-0f18-4b22-ba0d-0c6ab75da2b6 req-ded0a012-4c2c-4e48-b595-3a891e7c074b service nova] Releasing lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] No waiting events found dispatching network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:59 user nova-compute[74429]: WARNING nova.compute.manager [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received unexpected event network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d for instance with vm_state building and task_state spawning.
Oct 23 20:10:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:10:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] No waiting events found dispatching network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:10:59 user nova-compute[74429]: WARNING nova.compute.manager [req-59a5f182-e72f-45cf-a008-164c3283acb6 req-47a41e18-aba2-4d71-b44c-e45fe3a929a1 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received unexpected event network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d for instance with vm_state building and task_state spawning.
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:11:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Instance spawned successfully.
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:00 user nova-compute[74429]: INFO nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 23 20:11:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:11:00 user nova-compute[74429]: INFO nova.compute.manager [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Took 6.74 seconds to build instance.
Oct 23 20:11:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3b235a44-4f52-4352-ad7a-cfec384f2971 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:11:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Creating image(s)
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Ensure instance console log exists: /opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Start _get_guest_xml network_info=[{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '57c2240a-87b3-4bea-a813-0079951a7640', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b24653c-f35e-4aec-aa2c-d6cfd7616235', 'attached_at': '', 'detached_at': '', 'volume_id': '70ef0a13-d89b-44f4-822b-1cd41dadc596', 'serial': '70ef0a13-d89b-44f4-822b-1cd41dadc596'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:11:01 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:11:01 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:11:01 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:11:01 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:11:01 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[775b8172-44b4-4362-ab89-a66f524e714e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:11:01 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369b684-aac1-47d5-88df-306a3d4b9565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596] added
Oct 23 20:11:01 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ff226-f226-4dac-988a-0816759a9b98]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c171cb5-3f03-4e58-b7c7-cb8647f9e9bd]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCkMEvUN {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCkMEvUN" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cc85ec-dd3d-452c-a4fe-1d598d4f6f30]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCkMEvUN'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0bbb61-9f5f-4f8b-97ad-ad347684592a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57f5c6-ac7f-4b0c-a39d-d5038725c502]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:11:01 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:11:01 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:11:01 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:11:01 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:11:01 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:11:01 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --login" returned: 0 in 1.065s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f102d-467d-42de-8283-927d2f370937]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]
Oct 23 20:11:02 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.
Oct 23 20:11:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1380a-c541-4ba3-b6e5-60b877e19859]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1c3fe-a906-462e-afb7-5d05c849f1d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:11:02 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:11:02 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:11:02 user nova-compute[74429]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:11:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:11:02 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:11:02 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:11:02 user nova-compute[74429]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:11:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.280s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f91053-0a3b-464c-95cc-b4dc02113393]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:11:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.315s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] <== connect_volume: return (2317ms) {'type': 'block', 'scsi_wwn': '26234336331366238', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234336331366238', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-324355928',display_name='tempest-TestShelveInstance-server-324355928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-324355928',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL30oSke4ymfv0vz3p+dU0Hgeeae4AXnkTUqMREfedOj5jG1lKgyUT58KwUuZ6jA16jrr2rDPrGJvzCN/JVopmhp7570pefp1faRM+cS+asPYB3Ohj8styGRIA2nCLuiA==',key_name='tempest-TestShelveInstance-1295653859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4a64891d474410aacce30e403d2f625',ramdisk_id='',reservation_id='r-yngx7jwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1011766138',owner_user_name='tempest-TestShelveInstance-1011766138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:30Z,user_data=None,user_id='da9987f7f5024cb2b0094f1efd8fc942',uuid=5b24653c-f35e-4aec-aa2c-d6cfd7616235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converting VIF {"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.objects.instance [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:11:03 user nova-compute[74429]:   <uuid>5b24653c-f35e-4aec-aa2c-d6cfd7616235</uuid>
Oct 23 20:11:03 user nova-compute[74429]:   <name>instance-00000017</name>
Oct 23 20:11:03 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:11:03 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:11:03 user nova-compute[74429]:   <metadata>
Oct 23 20:11:03 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:11:03 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:11:03 user nova-compute[74429]:       <nova:name>tempest-TestShelveInstance-server-324355928</nova:name>
Oct 23 20:11:03 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:11:01</nova:creationTime>
Oct 23 20:11:03 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:11:03 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:11:03 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:11:03 user nova-compute[74429]:       <nova:owner>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:user uuid="da9987f7f5024cb2b0094f1efd8fc942">tempest-TestShelveInstance-1011766138-project-member</nova:user>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:project uuid="d4a64891d474410aacce30e403d2f625">tempest-TestShelveInstance-1011766138</nova:project>
Oct 23 20:11:03 user nova-compute[74429]:       </nova:owner>
Oct 23 20:11:03 user nova-compute[74429]:       <nova:ports>
Oct 23 20:11:03 user nova-compute[74429]:         <nova:port uuid="fac1362d-5d37-445e-9987-b454e179e242">
Oct 23 20:11:03 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 20:11:03 user nova-compute[74429]:         </nova:port>
Oct 23 20:11:03 user nova-compute[74429]:       </nova:ports>
Oct 23 20:11:03 user nova-compute[74429]:     </nova:instance>
Oct 23 20:11:03 user nova-compute[74429]:   </metadata>
Oct 23 20:11:03 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:11:03 user nova-compute[74429]:     <system>
Oct 23 20:11:03 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:11:03 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:11:03 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:11:03 user nova-compute[74429]:       <entry name="serial">5b24653c-f35e-4aec-aa2c-d6cfd7616235</entry>
Oct 23 20:11:03 user nova-compute[74429]:       <entry name="uuid">5b24653c-f35e-4aec-aa2c-d6cfd7616235</entry>
Oct 23 20:11:03 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:11:03 user nova-compute[74429]:     </system>
Oct 23 20:11:03 user nova-compute[74429]:   </sysinfo>
Oct 23 20:11:03 user nova-compute[74429]:   <os>
Oct 23 20:11:03 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:11:03 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:11:03 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:11:03 user nova-compute[74429]:   </os>
Oct 23 20:11:03 user nova-compute[74429]:   <features>
Oct 23 20:11:03 user nova-compute[74429]:     <acpi/>
Oct 23 20:11:03 user nova-compute[74429]:     <apic/>
Oct 23 20:11:03 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:11:03 user nova-compute[74429]:   </features>
Oct 23 20:11:03 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:11:03 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:11:03 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:11:03 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:11:03 user nova-compute[74429]:   </clock>
Oct 23 20:11:03 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:11:03 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:11:03 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:11:03 user nova-compute[74429]:   </cpu>
Oct 23 20:11:03 user nova-compute[74429]:   <devices>
Oct 23 20:11:03 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:11:03 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:11:03 user nova-compute[74429]:       <source dev="/dev/sdd"/>
Oct 23 20:11:03 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:11:03 user nova-compute[74429]:       <serial>70ef0a13-d89b-44f4-822b-1cd41dadc596</serial>
Oct 23 20:11:03 user nova-compute[74429]:     </disk>
Oct 23 20:11:03 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:11:03 user nova-compute[74429]:       <mac address="fa:16:3e:7e:cb:70"/>
Oct 23 20:11:03 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:11:03 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:11:03 user nova-compute[74429]:       <target dev="tapfac1362d-5d"/>
Oct 23 20:11:03 user nova-compute[74429]:     </interface>
Oct 23 20:11:03 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:11:03 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235/console.log" append="off"/>
Oct 23 20:11:03 user nova-compute[74429]:     </serial>
Oct 23 20:11:03 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:11:03 user nova-compute[74429]:     <video>
Oct 23 20:11:03 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:11:03 user nova-compute[74429]:     </video>
Oct 23 20:11:03 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:11:03 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:11:03 user nova-compute[74429]:     </rng>
Oct 23 20:11:03 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:11:03 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:11:03 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:11:03 user nova-compute[74429]:     </memballoon>
Oct 23 20:11:03 user nova-compute[74429]:   </devices>
Oct 23 20:11:03 user nova-compute[74429]: </domain>
Oct 23 20:11:03 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-324355928',display_name='tempest-TestShelveInstance-server-324355928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-324355928',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL30oSke4ymfv0vz3p+dU0Hgeeae4AXnkTUqMREfedOj5jG1lKgyUT58KwUuZ6jA16jrr2rDPrGJvzCN/JVopmhp7570pefp1faRM+cS+asPYB3Ohj8styGRIA2nCLuiA==',key_name='tempest-TestShelveInstance-1295653859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4a64891d474410aacce30e403d2f625',ramdisk_id='',reservation_id='r-yngx7jwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1011766138',owner_user_name='tempest-TestShelveInstance-1011766138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:10:30Z,user_data=None,user_id='da9987f7f5024cb2b0094f1efd8fc942',uuid=5b24653c-f35e-4aec-aa2c-d6cfd7616235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converting VIF {"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG os_vif [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c1e495-3398-5c5c-a360-ddc2521217d2', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfac1362d-5d, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfac1362d-5d, col_values=(('qos', UUID('c9b292ca-b545-4c0a-89aa-f503a9f541af')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfac1362d-5d, col_values=(('external_ids', {'iface-id': 'fac1362d-5d37-445e-9987-b454e179e242', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:cb:70', 'vm-uuid': '5b24653c-f35e-4aec-aa2c-d6cfd7616235'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:03 user nova-compute[74429]: INFO os_vif [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d')
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:11:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] No VIF found with MAC fa:16:3e:7e:cb:70, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-3e5a050f-a837-4c38-a2e3-c0878af1fddb req-bea283fd-574b-4df1-8c03-6ef5042fbaf8 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e5a050f-a837-4c38-a2e3-c0878af1fddb req-bea283fd-574b-4df1-8c03-6ef5042fbaf8 service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e5a050f-a837-4c38-a2e3-c0878af1fddb req-bea283fd-574b-4df1-8c03-6ef5042fbaf8 service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e5a050f-a837-4c38-a2e3-c0878af1fddb req-bea283fd-574b-4df1-8c03-6ef5042fbaf8 service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-3e5a050f-a837-4c38-a2e3-c0878af1fddb req-bea283fd-574b-4df1-8c03-6ef5042fbaf8 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:11:05 user nova-compute[74429]: WARNING nova.compute.manager [req-3e5a050f-a837-4c38-a2e3-c0878af1fddb req-bea283fd-574b-4df1-8c03-6ef5042fbaf8 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state building and task_state spawning.
Oct 23 20:11:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:11:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance spawned successfully.
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-ac6ff8d4-d594-4292-b86c-0499f007d8d3 req-20e70ddb-0b23-4a66-a312-18d6463bce9d service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ac6ff8d4-d594-4292-b86c-0499f007d8d3 req-20e70ddb-0b23-4a66-a312-18d6463bce9d service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ac6ff8d4-d594-4292-b86c-0499f007d8d3 req-20e70ddb-0b23-4a66-a312-18d6463bce9d service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ac6ff8d4-d594-4292-b86c-0499f007d8d3 req-20e70ddb-0b23-4a66-a312-18d6463bce9d service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-ac6ff8d4-d594-4292-b86c-0499f007d8d3 req-20e70ddb-0b23-4a66-a312-18d6463bce9d service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:11:07 user nova-compute[74429]: WARNING nova.compute.manager [req-ac6ff8d4-d594-4292-b86c-0499f007d8d3 req-20e70ddb-0b23-4a66-a312-18d6463bce9d service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state building and task_state spawning.
Oct 23 20:11:07 user nova-compute[74429]: INFO nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Took 6.53 seconds to spawn the instance on the hypervisor.
Oct 23 20:11:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:11:07 user nova-compute[74429]: INFO nova.compute.manager [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Took 39.13 seconds to build instance.
Oct 23 20:11:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-157e931e-ef93-4e81-aafb-27055611b615 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.298s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:16 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:11:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:11:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.384s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:23 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:11:23 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7301MB free_disk=25.318336486816406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dfa666c7-491b-41e3-8beb-165b4081235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5b24653c-f35e-4aec-aa2c-d6cfd7616235 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance de91660d-61a1-4e58-a75d-8fed5386b6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:11:23 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:11:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:11:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:11:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:11:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid dc41e78e-050f-429e-b0b9-f4473a07c2c7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updating instance_info_cache with network_info: [{"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-dc41e78e-050f-429e-b0b9-f4473a07c2c7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:11:26 user nova-compute[74429]: INFO nova.compute.manager [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] instance snapshotting
Oct 23 20:11:26 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Beginning live snapshot process
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json -f qcow2 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpawy0e8g6/52bea16b97fb445c96ecc4644778f9d1.delta 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpawy0e8g6/52bea16b97fb445c96ecc4644778f9d1.delta 1073741824" returned: 0 in 0.048s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:26 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 20:11:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:11:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] COPY block job progress, current cursor: 12386304 final cursor: 75497472 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:11:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74429) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 20:11:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 20:11:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:11:28 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:11:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpawy0e8g6/52bea16b97fb445c96ecc4644778f9d1.delta /opt/stack/data/nova/instances/snapshots/tmpawy0e8g6/52bea16b97fb445c96ecc4644778f9d1 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:11:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpawy0e8g6/52bea16b97fb445c96ecc4644778f9d1.delta /opt/stack/data/nova/instances/snapshots/tmpawy0e8g6/52bea16b97fb445c96ecc4644778f9d1" returned: 0 in 0.352s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:11:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Snapshot extracted, beginning image upload
Oct 23 20:11:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Snapshot image upload complete
Oct 23 20:11:31 user nova-compute[74429]: INFO nova.compute.manager [None req-52517c26-a803-4950-a60e-008e4bec2a1f tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Took 5.58 seconds to snapshot the instance on the hypervisor.
Oct 23 20:11:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:11:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:11:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:11:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:11:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:11:58 user nova-compute[74429]: INFO nova.compute.manager [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Detaching volume 42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8
Oct 23 20:11:58 user nova-compute[74429]: INFO nova.virt.block_device [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Attempting to driver detach volume 42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 from mountpoint /dev/vdb
Oct 23 20:11:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Attempting to detach device vdb from instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:11:58 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:11:58 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:11:58 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:11:58 user nova-compute[74429]:   <serial>42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8</serial>
Oct 23 20:11:58 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:11:58 user nova-compute[74429]: </disk>
Oct 23 20:11:58 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:11:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully detached device vdb from instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a from the persistent domain config.
Oct 23 20:11:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:11:58 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:11:58 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:11:58 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:11:58 user nova-compute[74429]:   <serial>42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8</serial>
Oct 23 20:11:58 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:11:58 user nova-compute[74429]: </disk>
Oct 23 20:11:58 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:11:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:12:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:14 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:12:14 user nova-compute[74429]: INFO nova.compute.claims [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Claim successful on node user
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:12:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.policy [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7120776c404379ad8793a5b357d94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e85b6b40e54b5e81ee9dabef1e6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:12:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Creating image(s)
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk 1073741824" returned: 0 in 0.054s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Successfully created port: e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Cannot resize image /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Ensure instance console log exists: /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Successfully updated port: e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquired lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-changed-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Refreshing instance network info cache due to event network-changed-e4d9ea6a-c873-44ba-93d3-21a5da11c826. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] Acquiring lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Releasing lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Instance network_info: |[{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] Acquired lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Refreshing network info cache for port e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Start _get_guest_xml network_info=[{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:12:17 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:12:17 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:12:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.objects.instance [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'pci_devices' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:12:17 user nova-compute[74429]:   <uuid>3315b73b-413e-40f2-89bf-e285b13d702a</uuid>
Oct 23 20:12:17 user nova-compute[74429]:   <name>instance-0000001a</name>
Oct 23 20:12:17 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:12:17 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:12:17 user nova-compute[74429]:   <metadata>
Oct 23 20:12:17 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:12:17 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:12:17 user nova-compute[74429]:       <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:12:17 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:12:17</nova:creationTime>
Oct 23 20:12:17 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:12:17 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:12:17 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:12:17 user nova-compute[74429]:       <nova:owner>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:12:17 user nova-compute[74429]:       </nova:owner>
Oct 23 20:12:17 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:12:17 user nova-compute[74429]:       <nova:ports>
Oct 23 20:12:17 user nova-compute[74429]:         <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:12:17 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:12:17 user nova-compute[74429]:         </nova:port>
Oct 23 20:12:17 user nova-compute[74429]:       </nova:ports>
Oct 23 20:12:17 user nova-compute[74429]:     </nova:instance>
Oct 23 20:12:17 user nova-compute[74429]:   </metadata>
Oct 23 20:12:17 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:12:17 user nova-compute[74429]:     <system>
Oct 23 20:12:17 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:12:17 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:12:17 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:12:17 user nova-compute[74429]:       <entry name="serial">3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:12:17 user nova-compute[74429]:       <entry name="uuid">3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:12:17 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:12:17 user nova-compute[74429]:     </system>
Oct 23 20:12:17 user nova-compute[74429]:   </sysinfo>
Oct 23 20:12:17 user nova-compute[74429]:   <os>
Oct 23 20:12:17 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:12:17 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:12:17 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:12:17 user nova-compute[74429]:   </os>
Oct 23 20:12:17 user nova-compute[74429]:   <features>
Oct 23 20:12:17 user nova-compute[74429]:     <acpi/>
Oct 23 20:12:17 user nova-compute[74429]:     <apic/>
Oct 23 20:12:17 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:12:17 user nova-compute[74429]:   </features>
Oct 23 20:12:17 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:12:17 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:12:17 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:12:17 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:12:17 user nova-compute[74429]:   </clock>
Oct 23 20:12:17 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:12:17 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:12:17 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:12:17 user nova-compute[74429]:   </cpu>
Oct 23 20:12:17 user nova-compute[74429]:   <devices>
Oct 23 20:12:17 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:12:17 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:12:17 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk"/>
Oct 23 20:12:17 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:12:17 user nova-compute[74429]:     </disk>
Oct 23 20:12:17 user nova-compute[74429]:     <disk type="file" device="cdrom">
Oct 23 20:12:17 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 20:12:17 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config"/>
Oct 23 20:12:17 user nova-compute[74429]:       <target dev="hda" bus="ide"/>
Oct 23 20:12:17 user nova-compute[74429]:     </disk>
Oct 23 20:12:17 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:12:17 user nova-compute[74429]:       <mac address="fa:16:3e:72:6c:0a"/>
Oct 23 20:12:17 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:12:17 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:12:17 user nova-compute[74429]:       <target dev="tape4d9ea6a-c8"/>
Oct 23 20:12:17 user nova-compute[74429]:     </interface>
Oct 23 20:12:17 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:12:17 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log" append="off"/>
Oct 23 20:12:17 user nova-compute[74429]:     </serial>
Oct 23 20:12:17 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:12:17 user nova-compute[74429]:     <video>
Oct 23 20:12:17 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:12:17 user nova-compute[74429]:     </video>
Oct 23 20:12:17 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:12:17 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:12:17 user nova-compute[74429]:     </rng>
Oct 23 20:12:17 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:12:17 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:12:17 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:12:17 user nova-compute[74429]:     </memballoon>
Oct 23 20:12:17 user nova-compute[74429]:   </devices>
Oct 23 20:12:17 user nova-compute[74429]: </domain>
Oct 23 20:12:17 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:12:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG os_vif [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c6678d9-1135-52e6-b3e1-91b92937ea5d', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4d9ea6a-c8, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4d9ea6a-c8, col_values=(('qos', UUID('04aea177-fef6-4361-917d-e830362e745a')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4d9ea6a-c8, col_values=(('external_ids', {'iface-id': 'e4d9ea6a-c873-44ba-93d3-21a5da11c826', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:6c:0a', 'vm-uuid': '3315b73b-413e-40f2-89bf-e285b13d702a'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:17 user nova-compute[74429]: INFO os_vif [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8')
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No BDM found with device name hda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No VIF found with MAC fa:16:3e:72:6c:0a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:12:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Using config drive
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Creating config drive at /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgc5nf4b3 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgc5nf4b3" returned: 0 in 0.076s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updated VIF entry in instance network info cache for port e4d9ea6a-c873-44ba-93d3-21a5da11c826. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b4a2f61a-7a34-4263-a263-decca0ed0727 req-a0ffc60b-340e-4a8d-83c9-30b276a05264 service nova] Releasing lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a is timed out.
Oct 23 20:12:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully detached device vdb from instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a from the live domain config.
Oct 23 20:12:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msAywLNn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:12:18 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f349a079-8bd4-47ec-8e17-6e9eba78bc8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:12:18 user nova-compute[74429]: No targets found.
Oct 23 20:12:18 user nova-compute[74429]: iSNS:
Oct 23 20:12:18 user nova-compute[74429]: No targets found.
Oct 23 20:12:18 user nova-compute[74429]: STATIC:
Oct 23 20:12:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596
Oct 23 20:12:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d
Oct 23 20:12:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4
Oct 23 20:12:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:12:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8
Oct 23 20:12:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f
Oct 23 20:12:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:18 user nova-compute[74429]: FIRMWARE:
Oct 23 20:12:18 user nova-compute[74429]: No targets found.
Oct 23 20:12:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:12:18 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:12:18 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b4f3d-0cfa-4e4b-92bb-2b52c4313c3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a496f-75f5-4e22-a92d-eaa7ff83d77d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d (non-flash)
Oct 23 20:12:18 user nova-compute[74429]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4 (non-flash)
Oct 23 20:12:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c6d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cee650-51b2-4bcd-8fcb-40f650020c94]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d823081-c352-4121-ad02-1898b1f15076]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dcb200-be12-4f93-beff-6e20aa2bdfda]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[231c75a4-af3e-4018-809f-d06f1010a809]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e015db41-47fc-4188-b776-12640d4a292c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:12:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[578ef959-b70b-43ec-b90c-bd896406191d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260]
Oct 23 20:12:19 user nova-compute[74429]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8, portal: 172.16.0.220,3260] successful.
Oct 23 20:12:19 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a3d2bb-a60b-4be4-a6f9-fee7fb5574b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a42daba-b5ea-4916-af4a-27cc94b862e5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== disconnect_volume: return (389ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-899d1a5f-bcf9-476a-9d41-69faf57d8117 req-7e9d8d1b-8e8d-48e0-a428-187119a6e513 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-899d1a5f-bcf9-476a-9d41-69faf57d8117 req-7e9d8d1b-8e8d-48e0-a428-187119a6e513 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-899d1a5f-bcf9-476a-9d41-69faf57d8117 req-7e9d8d1b-8e8d-48e0-a428-187119a6e513 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-899d1a5f-bcf9-476a-9d41-69faf57d8117 req-7e9d8d1b-8e8d-48e0-a428-187119a6e513 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-899d1a5f-bcf9-476a-9d41-69faf57d8117 req-7e9d8d1b-8e8d-48e0-a428-187119a6e513 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:19 user nova-compute[74429]: WARNING nova.compute.manager [req-899d1a5f-bcf9-476a-9d41-69faf57d8117 req-7e9d8d1b-8e8d-48e0-a428-187119a6e513 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 for instance with vm_state building and task_state spawning.
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing instance network info cache due to event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG nova.objects.instance [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39aa566c-dea5-4b43-a28a-e021888cf612 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.392s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG nova.network.neutron [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updated VIF entry in instance network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG nova.network.neutron [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2bff3973-bfbb-40bc-a83b-8ae22fed2494 req-0a48c469-fd78-4317-baf9-876f3e0c8a0d service nova] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74429) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-changed-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing instance network info cache due to event network-changed-fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing network info cache for port fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:21 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance destroyed successfully.
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b7fd79cb-7b2b-4a09-abee-0db5f4e5f80e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:21 user nova-compute[74429]: WARNING nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 for instance with vm_state building and task_state spawning.
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:21 user nova-compute[74429]: WARNING nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state None.
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:21 user nova-compute[74429]: WARNING nova.compute.manager [req-b714cf4f-f12a-4388-844c-4ba3f980303b req-93d21dae-9682-4cb8-b116-e37ee1661ec8 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state None.
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updated VIF entry in instance network info cache for port fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7311aa7-fadb-4fc9-98df-765cefd5f31e req-9b95e173-2022-46a1-a491-0bb21f1232ed service nova] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:21 user nova-compute[74429]: INFO nova.compute.manager [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Shelve offloading
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:12:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Instance spawned successfully.
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:22 user nova-compute[74429]: INFO nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Took 6.62 seconds to spawn the instance on the hypervisor.
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:22 user nova-compute[74429]: INFO nova.compute.manager [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Took 7.63 seconds to build instance.
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa6373ec-1d6e-4c55-a80e-b1d962b40645 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.755s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance destroyed successfully.
Oct 23 20:12:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-unplugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-unplugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:23 user nova-compute[74429]: WARNING nova.compute.manager [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-unplugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state active and task_state shelving.
Oct 23 20:12:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG nova.compute.manager [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:23 user nova-compute[74429]: WARNING nova.compute.manager [req-e780bcfa-0f0a-435f-96b9-8aa3303cf688 req-135fc778-7c3d-4faf-b61a-91472e02aece service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state active and task_state shelving.
Oct 23 20:12:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance destroyed successfully.
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'resources' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-324355928',display_name='tempest-TestShelveInstance-server-324355928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-324355928',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL30oSke4ymfv0vz3p+dU0Hgeeae4AXnkTUqMREfedOj5jG1lKgyUT58KwUuZ6jA16jrr2rDPrGJvzCN/JVopmhp7570pefp1faRM+cS+asPYB3Ohj8styGRIA2nCLuiA==',key_name='tempest-TestShelveInstance-1295653859',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4a64891d474410aacce30e403d2f625',ramdisk_id='',reservation_id='r-yngx7jwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1011766138',owner_user_name='tempest-TestShelveInstance-1011766138-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:11:08Z,user_data=None,user_id='da9987f7f5024cb2b0094f1efd8fc942',uuid=5b24653c-f35e-4aec-aa2c-d6cfd7616235,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converting VIF {"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_vif [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfac1362d-5d, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-changed-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing instance network info cache due to event network-changed-fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing network info cache for port fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9b292ca-b545-4c0a-89aa-f503a9f541af) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:24 user nova-compute[74429]: INFO os_vif [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d')
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:12:24 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ea99f-3d15-4daa-ae27-6d0bf8542c9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:12:24 user nova-compute[74429]: No targets found.
Oct 23 20:12:24 user nova-compute[74429]: iSNS:
Oct 23 20:12:24 user nova-compute[74429]: No targets found.
Oct 23 20:12:24 user nova-compute[74429]: STATIC:
Oct 23 20:12:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596
Oct 23 20:12:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d
Oct 23 20:12:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4
Oct 23 20:12:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:12:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:24 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f
Oct 23 20:12:24 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:12:24 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:12:24 user nova-compute[74429]: FIRMWARE:
Oct 23 20:12:24 user nova-compute[74429]: No targets found.
Oct 23 20:12:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:12:24 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:12:24 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d2632-43e1-48ae-bbb5-a12d6135dadc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd1e405-0b96-41a2-9222-5f482c928e8f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4 (non-flash)
Oct 23 20:12:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d69fd4-cf74-41d9-bc08-8c4efaaf8c1d (non-flash)
Oct 23 20:12:24 user nova-compute[74429]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ccd3c9-8b8c-46a2-927f-75e48872e3a4 (non-flash)
Oct 23 20:12:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c6d4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b9c7a7-6714-498f-88ee-af1dd5240005]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f9ce6d-f4c8-44cf-9146-aa6cc281a349]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:24 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39da4cf-3eb8-4a8c-84b7-cb0c4e9532a7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a7a359-835e-4950-81e4-c73434fdefa2]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5456c7-7225-4bdb-b79d-a24c28296374]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f96078a-d4e0-4fb8-af9e-5b9f29fbff18]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]
Oct 23 20:12:25 user nova-compute[74429]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.
Oct 23 20:12:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34761d-e0b1-4ca9-9424-7a2babe2c38a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.564s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] <== disconnect_volume: return (568ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:12:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Deleting instance files /opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235_del
Oct 23 20:12:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Deletion of /opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235_del complete
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updated VIF entry in instance network info cache for port fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": null, "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfac1362d-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-05ca47aa-f1ae-427e-8f8b-f2d2fec63bdf req-e179a7e1-b25d-4a22-9057-fde2ff1d5152 service nova] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:12:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7282MB free_disk=25.254878997802734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:27 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Deleted allocations for instance 5b24653c-f35e-4aec-aa2c-d6cfd7616235
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:27 user nova-compute[74429]: INFO nova.compute.manager [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Shelving
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dfa666c7-491b-41e3-8beb-165b4081235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance de91660d-61a1-4e58-a75d-8fed5386b6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 3315b73b-413e-40f2-89bf-e285b13d702a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-43bdfed8-3804-4f5f-9b9b-e151d7cdcbe4 req-f1591134-e803-47ca-b94c-66d08addc316 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-unplugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-43bdfed8-3804-4f5f-9b9b-e151d7cdcbe4 req-f1591134-e803-47ca-b94c-66d08addc316 service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-43bdfed8-3804-4f5f-9b9b-e151d7cdcbe4 req-f1591134-e803-47ca-b94c-66d08addc316 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-43bdfed8-3804-4f5f-9b9b-e151d7cdcbe4 req-f1591134-e803-47ca-b94c-66d08addc316 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-43bdfed8-3804-4f5f-9b9b-e151d7cdcbe4 req-f1591134-e803-47ca-b94c-66d08addc316 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-unplugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:27 user nova-compute[74429]: WARNING nova.compute.manager [req-43bdfed8-3804-4f5f-9b9b-e151d7cdcbe4 req-f1591134-e803-47ca-b94c-66d08addc316 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-unplugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state active and task_state shelving.
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.628s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:27 user nova-compute[74429]: DEBUG nova.objects.base [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Object Instance<5b24653c-f35e-4aec-aa2c-d6cfd7616235> lazy-loaded attributes: resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:12:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance destroyed successfully.
Oct 23 20:12:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Beginning cold snapshot process
Oct 23 20:12:28 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:12:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk /opt/stack/data/nova/instances/snapshots/tmpeqfe3d_a/45234659819b49a48959f817d80a211b {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:28 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:12:28 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:12:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.640s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e7a4dc6c-1890-41cf-be20-0490a4bf5a42 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.613s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk /opt/stack/data/nova/instances/snapshots/tmpeqfe3d_a/45234659819b49a48959f817d80a211b" returned: 0 in 0.893s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Snapshot extracted, beginning image upload
Oct 23 20:12:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb1daa7-3daa-450c-bd22-c44fed1cfa95 req-54ea7688-57e1-4a5c-b38c-a85f7ed02721 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb1daa7-3daa-450c-bd22-c44fed1cfa95 req-54ea7688-57e1-4a5c-b38c-a85f7ed02721 service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb1daa7-3daa-450c-bd22-c44fed1cfa95 req-54ea7688-57e1-4a5c-b38c-a85f7ed02721 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb1daa7-3daa-450c-bd22-c44fed1cfa95 req-54ea7688-57e1-4a5c-b38c-a85f7ed02721 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb1daa7-3daa-450c-bd22-c44fed1cfa95 req-54ea7688-57e1-4a5c-b38c-a85f7ed02721 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:29 user nova-compute[74429]: WARNING nova.compute.manager [req-5cb1daa7-3daa-450c-bd22-c44fed1cfa95 req-54ea7688-57e1-4a5c-b38c-a85f7ed02721 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 20:12:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:29 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [{"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-9901998c-ee34-4de9-b819-bc6c23bdfcdd" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:12:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:12:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Snapshot image upload complete
Oct 23 20:12:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:32 user nova-compute[74429]: INFO nova.compute.manager [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Shelve offloading
Oct 23 20:12:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance destroyed successfully.
Oct 23 20:12:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:12:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance destroyed successfully.
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'resources' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-484815685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-484815685',id=24,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIhi7GEHDm9o+sD3rEkCWx650rr/AtW//YwSwASR0/JSk98CdjaUsTSUGFMNwA5wN8lur+M/btid/agHB9nMoAuQU3xIB4GLFaeid2O7TMdil3U3nKW+txvk0hJjaH0fQ==',key_name='tempest-keypair-383380181',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-xfgweb4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member',shelved_at='2023-10-23T20:12:32.078187',shelved_host='user',shelved_image_id='4ee0fbbf-0b5c-4ab5-b320-ed534f974d49'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=de91660d-61a1-4e58-a75d-8fed5386b6de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG os_vif [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a399db8-c2, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2945d7ba-558a-4574-ac35-a8324239e749) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing instance network info cache due to event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:33 user nova-compute[74429]: INFO os_vif [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2')
Oct 23 20:12:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Deleting instance files /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de_del
Oct 23 20:12:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Deletion of /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de_del complete
Oct 23 20:12:33 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Deleted allocations for instance de91660d-61a1-4e58-a75d-8fed5386b6de
Oct 23 20:12:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'numa_topology' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:33 user nova-compute[74429]: DEBUG nova.objects.base [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<de91660d-61a1-4e58-a75d-8fed5386b6de> lazy-loaded attributes: resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "ec66a751-5180-4b82-98ec-b82f9bda1f02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "ec66a751-5180-4b82-98ec-b82f9bda1f02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updated VIF entry in instance network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7a399db8-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7370a401-46f0-4956-b588-85da3f2cfb18 req-5cdbbe46-80f2-4a55-abde-a95b8d0437e7 service nova] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.027s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:12:34 user nova-compute[74429]: INFO nova.compute.claims [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Claim successful on node user
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6ead2b9b-4682-4da0-9ed1-b060bce829eb tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.161s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:12:34 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:12:34 user nova-compute[74429]: DEBUG nova.policy [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '734b0b0d04104bfeab582780b77764cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201753405b7c4553af3b39f82311a3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:12:35 user nova-compute[74429]: INFO nova.virt.block_device [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Booting with volume-backed-image 2ada0c77-c749-4517-8f1f-639beb4e6c0a at /dev/vda
Oct 23 20:12:35 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Successfully created port: ba460f6f-f27e-4c37-a0b3-7fa0789083bb {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Successfully updated port: ba460f6f-f27e-4c37-a0b3-7fa0789083bb {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "refresh_cache-ec66a751-5180-4b82-98ec-b82f9bda1f02" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquired lock "refresh_cache-ec66a751-5180-4b82-98ec-b82f9bda1f02" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Received event network-changed-ba460f6f-f27e-4c37-a0b3-7fa0789083bb {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Refreshing instance network info cache due to event network-changed-ba460f6f-f27e-4c37-a0b3-7fa0789083bb. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] Acquiring lock "refresh_cache-ec66a751-5180-4b82-98ec-b82f9bda1f02" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Updating instance_info_cache with network_info: [{"id": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "address": "fa:16:3e:19:de:e2", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba460f6f-f2", "ovs_interfaceid": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Releasing lock "refresh_cache-ec66a751-5180-4b82-98ec-b82f9bda1f02" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Instance network_info: |[{"id": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "address": "fa:16:3e:19:de:e2", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba460f6f-f2", "ovs_interfaceid": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] Acquired lock "refresh_cache-ec66a751-5180-4b82-98ec-b82f9bda1f02" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Refreshing network info cache for port ba460f6f-f27e-4c37-a0b3-7fa0789083bb {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Updated VIF entry in instance network info cache for port ba460f6f-f27e-4c37-a0b3-7fa0789083bb. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Updating instance_info_cache with network_info: [{"id": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "address": "fa:16:3e:19:de:e2", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba460f6f-f2", "ovs_interfaceid": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-306b3377-f792-498d-b53d-603aa8ca357a req-51dad888-0a65-4f11-b651-1ac8b4cbf511 service nova] Releasing lock "refresh_cache-ec66a751-5180-4b82-98ec-b82f9bda1f02" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:12:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:12:44 user nova-compute[74429]: INFO nova.compute.claims [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Claim successful on node user
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:12:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.policy [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6161756c0a9a4f6ba7a319801ba19818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f5bd02ac3b49d8b904b56e2e89eeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:12:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Creating image(s)
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "/opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "/opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "/opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:45 user nova-compute[74429]: INFO nova.compute.manager [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Detaching volume 3a5565ff-d242-42c5-91ce-6c81ad7dc70f
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Successfully created port: 82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:12:45 user nova-compute[74429]: INFO nova.virt.block_device [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Attempting to driver detach volume 3a5565ff-d242-42c5-91ce-6c81ad7dc70f from mountpoint /dev/vdb
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk 1073741824" returned: 0 in 0.056s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Attempting to detach device vdb from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:12:45 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:12:45 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:12:45 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:12:45 user nova-compute[74429]:   <serial>3a5565ff-d242-42c5-91ce-6c81ad7dc70f</serial>
Oct 23 20:12:45 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:12:45 user nova-compute[74429]: </disk>
Oct 23 20:12:45 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:12:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully detached device vdb from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c from the persistent domain config.
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:12:45 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:12:45 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:12:45 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:12:45 user nova-compute[74429]:   <serial>3a5565ff-d242-42c5-91ce-6c81ad7dc70f</serial>
Oct 23 20:12:45 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:12:45 user nova-compute[74429]: </disk>
Oct 23 20:12:45 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:12:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Cannot resize image /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Ensure instance console log exists: /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Successfully updated port: 82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "refresh_cache-e50c5c04-932e-4202-b660-bfbcedd2695e" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquired lock "refresh_cache-e50c5c04-932e-4202-b660-bfbcedd2695e" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-changed-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Refreshing instance network info cache due to event network-changed-82becb71-3f29-437d-926b-67fa1f5389a0. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] Acquiring lock "refresh_cache-e50c5c04-932e-4202-b660-bfbcedd2695e" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Updating instance_info_cache with network_info: [{"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Releasing lock "refresh_cache-e50c5c04-932e-4202-b660-bfbcedd2695e" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Instance network_info: |[{"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] Acquired lock "refresh_cache-e50c5c04-932e-4202-b660-bfbcedd2695e" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Refreshing network info cache for port 82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Start _get_guest_xml network_info=[{"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:12:46 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:12:46 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-377453610',display_name='tempest-ServersNegativeTestJSON-server-377453610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-377453610',id=28,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7f5bd02ac3b49d8b904b56e2e89eeef',ramdisk_id='',reservation_id='r-mmpldq0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-254346405',owner_user_name='tempest-ServersNegativeTestJSON-254346405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:12:45Z,user_data=None,user_id='6161756c0a9a4f6ba7a319801ba19818',uuid=e50c5c04-932e-4202-b660-bfbcedd2695e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converting VIF {"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lazy-loading 'pci_devices' on Instance uuid e50c5c04-932e-4202-b660-bfbcedd2695e {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:12:46 user nova-compute[74429]:   <uuid>e50c5c04-932e-4202-b660-bfbcedd2695e</uuid>
Oct 23 20:12:46 user nova-compute[74429]:   <name>instance-0000001c</name>
Oct 23 20:12:46 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:12:46 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:12:46 user nova-compute[74429]:   <metadata>
Oct 23 20:12:46 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:12:46 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:12:46 user nova-compute[74429]:       <nova:name>tempest-ServersNegativeTestJSON-server-377453610</nova:name>
Oct 23 20:12:46 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:12:46</nova:creationTime>
Oct 23 20:12:46 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:12:46 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:12:46 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:12:46 user nova-compute[74429]:       <nova:owner>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:user uuid="6161756c0a9a4f6ba7a319801ba19818">tempest-ServersNegativeTestJSON-254346405-project-member</nova:user>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:project uuid="b7f5bd02ac3b49d8b904b56e2e89eeef">tempest-ServersNegativeTestJSON-254346405</nova:project>
Oct 23 20:12:46 user nova-compute[74429]:       </nova:owner>
Oct 23 20:12:46 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:12:46 user nova-compute[74429]:       <nova:ports>
Oct 23 20:12:46 user nova-compute[74429]:         <nova:port uuid="82becb71-3f29-437d-926b-67fa1f5389a0">
Oct 23 20:12:46 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 20:12:46 user nova-compute[74429]:         </nova:port>
Oct 23 20:12:46 user nova-compute[74429]:       </nova:ports>
Oct 23 20:12:46 user nova-compute[74429]:     </nova:instance>
Oct 23 20:12:46 user nova-compute[74429]:   </metadata>
Oct 23 20:12:46 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:12:46 user nova-compute[74429]:     <system>
Oct 23 20:12:46 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:12:46 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:12:46 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:12:46 user nova-compute[74429]:       <entry name="serial">e50c5c04-932e-4202-b660-bfbcedd2695e</entry>
Oct 23 20:12:46 user nova-compute[74429]:       <entry name="uuid">e50c5c04-932e-4202-b660-bfbcedd2695e</entry>
Oct 23 20:12:46 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:12:46 user nova-compute[74429]:     </system>
Oct 23 20:12:46 user nova-compute[74429]:   </sysinfo>
Oct 23 20:12:46 user nova-compute[74429]:   <os>
Oct 23 20:12:46 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:12:46 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:12:46 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:12:46 user nova-compute[74429]:   </os>
Oct 23 20:12:46 user nova-compute[74429]:   <features>
Oct 23 20:12:46 user nova-compute[74429]:     <acpi/>
Oct 23 20:12:46 user nova-compute[74429]:     <apic/>
Oct 23 20:12:46 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:12:46 user nova-compute[74429]:   </features>
Oct 23 20:12:46 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:12:46 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:12:46 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:12:46 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:12:46 user nova-compute[74429]:   </clock>
Oct 23 20:12:46 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:12:46 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:12:46 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:12:46 user nova-compute[74429]:   </cpu>
Oct 23 20:12:46 user nova-compute[74429]:   <devices>
Oct 23 20:12:46 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:12:46 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:12:46 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk"/>
Oct 23 20:12:46 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:12:46 user nova-compute[74429]:     </disk>
Oct 23 20:12:46 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:12:46 user nova-compute[74429]:       <mac address="fa:16:3e:4b:48:bf"/>
Oct 23 20:12:46 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:12:46 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:12:46 user nova-compute[74429]:       <target dev="tap82becb71-3f"/>
Oct 23 20:12:46 user nova-compute[74429]:     </interface>
Oct 23 20:12:46 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:12:46 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/console.log" append="off"/>
Oct 23 20:12:46 user nova-compute[74429]:     </serial>
Oct 23 20:12:46 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:12:46 user nova-compute[74429]:     <video>
Oct 23 20:12:46 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:12:46 user nova-compute[74429]:     </video>
Oct 23 20:12:46 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:12:46 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:12:46 user nova-compute[74429]:     </rng>
Oct 23 20:12:46 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:12:46 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:12:46 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:12:46 user nova-compute[74429]:     </memballoon>
Oct 23 20:12:46 user nova-compute[74429]:   </devices>
Oct 23 20:12:46 user nova-compute[74429]: </domain>
Oct 23 20:12:46 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-377453610',display_name='tempest-ServersNegativeTestJSON-server-377453610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-377453610',id=28,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7f5bd02ac3b49d8b904b56e2e89eeef',ramdisk_id='',reservation_id='r-mmpldq0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-254346405',owner_user_name='tempest-ServersNegativeTestJSON-254346405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:12:45Z,user_data=None,user_id='6161756c0a9a4f6ba7a319801ba19818',uuid=e50c5c04-932e-4202-b660-bfbcedd2695e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converting VIF {"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG os_vif [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '133e6224-ac6a-5aa6-a371-4a3a18b46e20', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82becb71-3f, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82becb71-3f, col_values=(('qos', UUID('008409d8-88db-4ff7-bb00-114d91bf2837')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82becb71-3f, col_values=(('external_ids', {'iface-id': '82becb71-3f29-437d-926b-67fa1f5389a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:48:bf', 'vm-uuid': 'e50c5c04-932e-4202-b660-bfbcedd2695e'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:46 user nova-compute[74429]: INFO os_vif [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f')
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:12:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] No VIF found with MAC fa:16:3e:4b:48:bf, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:12:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Updated VIF entry in instance network info cache for port 82becb71-3f29-437d-926b-67fa1f5389a0. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:12:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Updating instance_info_cache with network_info: [{"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:12:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3fcbcd0f-3faa-4f5a-9771-9c936a178ccc req-2e4141d6-a5d6-422a-99d5-a24c48adec31 service nova] Releasing lock "refresh_cache-e50c5c04-932e-4202-b660-bfbcedd2695e" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-02d37ad2-e119-47a4-acdf-6f860b9068a8 req-81d3b4c3-d117-480f-b34b-9989d90934ce service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-02d37ad2-e119-47a4-acdf-6f860b9068a8 req-81d3b4c3-d117-480f-b34b-9989d90934ce service nova] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-02d37ad2-e119-47a4-acdf-6f860b9068a8 req-81d3b4c3-d117-480f-b34b-9989d90934ce service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-02d37ad2-e119-47a4-acdf-6f860b9068a8 req-81d3b4c3-d117-480f-b34b-9989d90934ce service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-02d37ad2-e119-47a4-acdf-6f860b9068a8 req-81d3b4c3-d117-480f-b34b-9989d90934ce service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] No waiting events found dispatching network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:48 user nova-compute[74429]: WARNING nova.compute.manager [req-02d37ad2-e119-47a4-acdf-6f860b9068a8 req-81d3b4c3-d117-480f-b34b-9989d90934ce service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received unexpected event network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 for instance with vm_state building and task_state spawning.
Oct 23 20:12:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:12:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Instance spawned successfully.
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:12:50 user nova-compute[74429]: INFO nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:12:50 user nova-compute[74429]: INFO nova.compute.manager [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Took 5.82 seconds to build instance.
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-b869a3e6-7b50-422c-8621-7a69e712b8ca req-20205282-b411-40b3-92e9-67292f8268c7 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b869a3e6-7b50-422c-8621-7a69e712b8ca req-20205282-b411-40b3-92e9-67292f8268c7 service nova] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b869a3e6-7b50-422c-8621-7a69e712b8ca req-20205282-b411-40b3-92e9-67292f8268c7 service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b869a3e6-7b50-422c-8621-7a69e712b8ca req-20205282-b411-40b3-92e9-67292f8268c7 service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-b869a3e6-7b50-422c-8621-7a69e712b8ca req-20205282-b411-40b3-92e9-67292f8268c7 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] No waiting events found dispatching network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:12:50 user nova-compute[74429]: WARNING nova.compute.manager [req-b869a3e6-7b50-422c-8621-7a69e712b8ca req-20205282-b411-40b3-92e9-67292f8268c7 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received unexpected event network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 for instance with vm_state active and task_state None.
Oct 23 20:12:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa83a2ee-280a-46f0-8e10-e85959d4afae tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.910s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:12:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:12:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG os_brick.utils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[742e3fba-ed05-4db7-a060-eba2278fd40c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa2b301-7c20-4485-89c7-5ff6d884fcc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda8f2d4-8d1f-4a04-afe0-f10e5d80bde4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c191740f-5667-47e2-8192-aa921a21fba8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:13:01 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:13:01 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf5176-659d-47fb-93bb-6c581ad69961]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG os_brick.utils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Updating existing volume attachment record: ce73dedb-ad6a-4c6a-bd73-a32aa4ba3796 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:13:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:06 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c is timed out.
Oct 23 20:13:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully detached device vdb from instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c from the live domain config.
Oct 23 20:13:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdUNjmuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:13:06 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4643a1-d875-4343-a128-84452913108b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:13:06 user nova-compute[74429]: No targets found.
Oct 23 20:13:06 user nova-compute[74429]: iSNS:
Oct 23 20:13:06 user nova-compute[74429]: No targets found.
Oct 23 20:13:06 user nova-compute[74429]: STATIC:
Oct 23 20:13:06 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:13:06 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:13:06 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:13:06 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f
Oct 23 20:13:06 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:13:06 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:13:06 user nova-compute[74429]: FIRMWARE:
Oct 23 20:13:06 user nova-compute[74429]: No targets found.
Oct 23 20:13:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:13:06 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:13:06 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbd335c-b340-4ec1-aba4-d18cc65e4a7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7db177-5e23-49af-9608-f20e7f87161c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:13:06 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:13:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:13:06 user nova-compute[74429]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f (non-flash)
Oct 23 20:13:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5015c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef98070-660a-40c9-b5d2-d11bc016f1a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8503affb-87df-4093-8d7c-0224f97f45a6]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605e269-9b1f-48e4-be34-ca480f67eeb4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f46d99-12d1-4705-8c25-2abb2bd7dd6b]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfdc455-f76d-43a5-aa8f-d7b0614d69cb]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a9d464-59f8-4c80-b182-6b12db3392d8]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260]
Oct 23 20:13:06 user nova-compute[74429]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f, portal: 172.16.0.220,3260] successful.
Oct 23 20:13:06 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5565ff-d242-42c5-91ce-6c81ad7dc70f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f5bfb-58e3-4463-bd68-96856cda7a52]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== disconnect_volume: return (293ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:13:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:13:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'flavor' on Instance uuid b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-275bdf5b-8119-44c8-aec2-954f7d22058a tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.volume.cinder [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Update attachment failed for attachment ce73dedb-ad6a-4c6a-bd73-a32aa4ba3796. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Traceback (most recent call last):
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     driver_block_device.attach_block_devices(
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     _log_and_attach(device)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     bdm.attach(*attach_args, **attach_kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 835, in attach
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     super(DriverVolImageBlockDevice, self).attach(
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     ret_val = method(obj, context, *args, **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     self._do_attach(context, instance, volume, volume_api,
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     self._volume_attach(context, volume, connector, instance,
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     connection_info = volume_api.attachment_update(
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     res = method(self, ctx, *args, **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     with excutils.save_and_reraise_exception():
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     self.force_reraise()
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     raise self.value
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     return method.func(obj, *args, **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     resp = self._update('/attachments/%s' % id, body)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     return self.request(url, method, **kwargs)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02]     raise exceptions.from_response(resp, body)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0)
Oct 23 20:13:07 user nova-compute[74429]: ERROR nova.compute.manager [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] 
Oct 23 20:13:07 user nova-compute[74429]: DEBUG nova.compute.claims [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Aborting claim: <nova.compute.claims.Claim object at 0x7f7d2c544460> {{(pid=74429) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 23 20:13:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.428s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Build of instance ec66a751-5180-4b82-98ec-b82f9bda1f02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0) {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.utils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Build of instance ec66a751-5180-4b82-98ec-b82f9bda1f02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74429) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 23 20:13:08 user nova-compute[74429]: ERROR nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Build of instance ec66a751-5180-4b82-98ec-b82f9bda1f02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0): nova.exception.BuildAbortException: Build of instance ec66a751-5180-4b82-98ec-b82f9bda1f02 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5aeaa5bf-d597-4e39-9f3c-a3db9a279fa0)
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Unplugging VIFs for instance {{(pid=74429) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-500536588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-500536588',id=27,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-xyai6jaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:12:35Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=ec66a751-5180-4b82-98ec-b82f9bda1f02,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "address": "fa:16:3e:19:de:e2", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba460f6f-f2", "ovs_interfaceid": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "address": "fa:16:3e:19:de:e2", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba460f6f-f2", "ovs_interfaceid": "ba460f6f-f27e-4c37-a0b3-7fa0789083bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:de:e2,bridge_name='br-int',has_traffic_filtering=True,id=ba460f6f-f27e-4c37-a0b3-7fa0789083bb,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba460f6f-f2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG os_vif [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:de:e2,bridge_name='br-int',has_traffic_filtering=True,id=ba460f6f-f27e-4c37-a0b3-7fa0789083bb,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba460f6f-f2') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba460f6f-f2, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:13:08 user nova-compute[74429]: INFO os_vif [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:de:e2,bridge_name='br-int',has_traffic_filtering=True,id=ba460f6f-f27e-4c37-a0b3-7fa0789083bb,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba460f6f-f2')
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Unplugged VIFs for instance {{(pid=74429) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:13:08 user nova-compute[74429]: INFO nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Took 0.48 seconds to deallocate network for instance.
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Detaching volume: 8b81c1d2-673b-495f-8c9c-dc0857404f09 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 23 20:13:08 user nova-compute[74429]: INFO nova.compute.manager [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Detaching volume 8b81c1d2-673b-495f-8c9c-dc0857404f09
Oct 23 20:13:08 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: ec66a751-5180-4b82-98ec-b82f9bda1f02] Skipping driver_detach during remote rebuild. {{(pid=74429) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 23 20:13:09 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Deleted allocations for instance ec66a751-5180-4b82-98ec-b82f9bda1f02
Oct 23 20:13:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-433151c6-5c3f-469e-bcf9-5183c29f458a tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "ec66a751-5180-4b82-98ec-b82f9bda1f02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.947s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:20 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:13:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dfa666c7-491b-41e3-8beb-165b4081235f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:24 user nova-compute[74429]: INFO nova.compute.manager [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Terminating instance
Oct 23 20:13:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-e368a170-73fe-4392-82fb-33ab00091189 req-9652435a-eb74-46d3-9b3f-c4d958417bd4 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-vif-unplugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e368a170-73fe-4392-82fb-33ab00091189 req-9652435a-eb74-46d3-9b3f-c4d958417bd4 service nova] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e368a170-73fe-4392-82fb-33ab00091189 req-9652435a-eb74-46d3-9b3f-c4d958417bd4 service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e368a170-73fe-4392-82fb-33ab00091189 req-9652435a-eb74-46d3-9b3f-c4d958417bd4 service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-e368a170-73fe-4392-82fb-33ab00091189 req-9652435a-eb74-46d3-9b3f-c4d958417bd4 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] No waiting events found dispatching network-vif-unplugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-e368a170-73fe-4392-82fb-33ab00091189 req-9652435a-eb74-46d3-9b3f-c4d958417bd4 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-vif-unplugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:13:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Instance destroyed successfully.
Oct 23 20:13:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:13:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7696MB free_disk=25.16613006591797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.objects.instance [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'resources' on Instance uuid dfa666c7-491b-41e3-8beb-165b4081235f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1220970340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1220970340',id=22,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-6numxypv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:11:32Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=dfa666c7-491b-41e3-8beb-165b4081235f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "address": "fa:16:3e:73:e5:a5", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45263d8f-f8", "ovs_interfaceid": "45263d8f-f81c-446e-8c6e-0b6aaba8e5e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG os_vif [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45263d8f-f8, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=328a3205-7571-4f20-97cd-f2aa26e7d3cf) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:13:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:25 user nova-compute[74429]: INFO os_vif [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:a5,bridge_name='br-int',has_traffic_filtering=True,id=45263d8f-f81c-446e-8c6e-0b6aaba8e5e4,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45263d8f-f8')
Oct 23 20:13:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Deleting instance files /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f_del
Oct 23 20:13:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Deletion of /opt/stack/data/nova/instances/dfa666c7-491b-41e3-8beb-165b4081235f_del complete
Oct 23 20:13:26 user nova-compute[74429]: INFO nova.compute.manager [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 23 20:13:26 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dfa666c7-491b-41e3-8beb-165b4081235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 3315b73b-413e-40f2-89bf-e285b13d702a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance e50c5c04-932e-4202-b660-bfbcedd2695e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:26 user nova-compute[74429]: INFO nova.compute.manager [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Rescuing
Oct 23 20:13:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:13:26 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:13:26 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Took 0.94 seconds to deallocate network for instance.
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] Acquiring lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] Lock "dfa666c7-491b-41e3-8beb-165b4081235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] No waiting events found dispatching network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:27 user nova-compute[74429]: WARNING nova.compute.manager [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received unexpected event network-vif-plugged-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 for instance with vm_state deleted and task_state None.
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-d6815a56-f637-43ac-a315-23323a88b490 req-66d5b9f4-7400-4817-bc3f-204720018a31 service nova] [instance: dfa666c7-491b-41e3-8beb-165b4081235f] Received event network-vif-deleted-45263d8f-f81c-446e-8c6e-0b6aaba8e5e4 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:27 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Deleted allocations for instance dfa666c7-491b-41e3-8beb-165b4081235f
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-503cc3cd-40bb-4421-90fd-45925a81b6a9 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dfa666c7-491b-41e3-8beb-165b4081235f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-594fe5b4-df9d-4330-ac94-4122723d2cc4 req-e7c7c507-c6c5-4661-8f19-a04d51362382 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-594fe5b4-df9d-4330-ac94-4122723d2cc4 req-e7c7c507-c6c5-4661-8f19-a04d51362382 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-594fe5b4-df9d-4330-ac94-4122723d2cc4 req-e7c7c507-c6c5-4661-8f19-a04d51362382 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-594fe5b4-df9d-4330-ac94-4122723d2cc4 req-e7c7c507-c6c5-4661-8f19-a04d51362382 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-594fe5b4-df9d-4330-ac94-4122723d2cc4 req-e7c7c507-c6c5-4661-8f19-a04d51362382 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:27 user nova-compute[74429]: WARNING nova.compute.manager [req-594fe5b4-df9d-4330-ac94-4122723d2cc4 req-e7c7c507-c6c5-4661-8f19-a04d51362382 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state active and task_state rescuing.
Oct 23 20:13:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:27 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance destroyed successfully.
Oct 23 20:13:27 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Attempting rescue
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74429) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:13:27 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Creating image(s)
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue" returned: 0 in 0.047s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'migration_context' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.base [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<6c590343-5b24-4425-90be-423c44902c73> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Start _get_guest_xml network_info=[{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:68:98:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'resources' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.base [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<6c590343-5b24-4425-90be-423c44902c73> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.base [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<6c590343-5b24-4425-90be-423c44902c73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:13:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:13:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.base [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<6c590343-5b24-4425-90be-423c44902c73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1207176885',display_name='tempest-ServerRescueNegativeTestJSON-server-1207176885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1207176885',id=20,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-0v5arxxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:08:41Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=6c590343-5b24-4425-90be-423c44902c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:68:98:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:68:98:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.objects.base [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<6c590343-5b24-4425-90be-423c44902c73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:13:28 user nova-compute[74429]:   <uuid>6c590343-5b24-4425-90be-423c44902c73</uuid>
Oct 23 20:13:28 user nova-compute[74429]:   <name>instance-00000014</name>
Oct 23 20:13:28 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:13:28 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:13:28 user nova-compute[74429]:   <metadata>
Oct 23 20:13:28 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:13:28 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:13:28 user nova-compute[74429]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1207176885</nova:name>
Oct 23 20:13:28 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:13:28</nova:creationTime>
Oct 23 20:13:28 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:13:28 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:13:28 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:13:28 user nova-compute[74429]:       <nova:owner>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:user uuid="c660b1cec6dd476aa14a3d0fb74ebd4a">tempest-ServerRescueNegativeTestJSON-1224059578-project-member</nova:user>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:project uuid="9dbb9beb49ad42fbaf6d07c88babe563">tempest-ServerRescueNegativeTestJSON-1224059578</nova:project>
Oct 23 20:13:28 user nova-compute[74429]:       </nova:owner>
Oct 23 20:13:28 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:13:28 user nova-compute[74429]:       <nova:ports>
Oct 23 20:13:28 user nova-compute[74429]:         <nova:port uuid="866a6953-5f5d-4930-bf06-485bb37b77df">
Oct 23 20:13:28 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 20:13:28 user nova-compute[74429]:         </nova:port>
Oct 23 20:13:28 user nova-compute[74429]:       </nova:ports>
Oct 23 20:13:28 user nova-compute[74429]:     </nova:instance>
Oct 23 20:13:28 user nova-compute[74429]:   </metadata>
Oct 23 20:13:28 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:13:28 user nova-compute[74429]:     <system>
Oct 23 20:13:28 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:13:28 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:13:28 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:13:28 user nova-compute[74429]:       <entry name="serial">6c590343-5b24-4425-90be-423c44902c73</entry>
Oct 23 20:13:28 user nova-compute[74429]:       <entry name="uuid">6c590343-5b24-4425-90be-423c44902c73</entry>
Oct 23 20:13:28 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:13:28 user nova-compute[74429]:     </system>
Oct 23 20:13:28 user nova-compute[74429]:   </sysinfo>
Oct 23 20:13:28 user nova-compute[74429]:   <os>
Oct 23 20:13:28 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:13:28 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:13:28 user nova-compute[74429]:   </os>
Oct 23 20:13:28 user nova-compute[74429]:   <features>
Oct 23 20:13:28 user nova-compute[74429]:     <acpi/>
Oct 23 20:13:28 user nova-compute[74429]:     <apic/>
Oct 23 20:13:28 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:13:28 user nova-compute[74429]:   </features>
Oct 23 20:13:28 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:13:28 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:13:28 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:13:28 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:13:28 user nova-compute[74429]:   </clock>
Oct 23 20:13:28 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:13:28 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:13:28 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:13:28 user nova-compute[74429]:   </cpu>
Oct 23 20:13:28 user nova-compute[74429]:   <devices>
Oct 23 20:13:28 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:13:28 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:13:28 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue"/>
Oct 23 20:13:28 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:13:28 user nova-compute[74429]:     </disk>
Oct 23 20:13:28 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:13:28 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:13:28 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk"/>
Oct 23 20:13:28 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:13:28 user nova-compute[74429]:     </disk>
Oct 23 20:13:28 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:13:28 user nova-compute[74429]:       <mac address="fa:16:3e:68:98:f0"/>
Oct 23 20:13:28 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:13:28 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:13:28 user nova-compute[74429]:       <target dev="tap866a6953-5f"/>
Oct 23 20:13:28 user nova-compute[74429]:     </interface>
Oct 23 20:13:28 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:13:28 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/console.log" append="off"/>
Oct 23 20:13:28 user nova-compute[74429]:     </serial>
Oct 23 20:13:28 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:13:28 user nova-compute[74429]:     <video>
Oct 23 20:13:28 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:13:28 user nova-compute[74429]:     </video>
Oct 23 20:13:28 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:13:28 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:13:28 user nova-compute[74429]:     </rng>
Oct 23 20:13:28 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:13:28 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:13:28 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:13:28 user nova-compute[74429]:     </memballoon>
Oct 23 20:13:28 user nova-compute[74429]:   </devices>
Oct 23 20:13:28 user nova-compute[74429]: </domain>
Oct 23 20:13:28 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:13:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance destroyed successfully.
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:13:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:68:98:f0, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-4c048dc0-37b0-43cb-8324-f683332c14de req-a792c1a4-3d15-4886-a61b-e4fec15962f3 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c048dc0-37b0-43cb-8324-f683332c14de req-a792c1a4-3d15-4886-a61b-e4fec15962f3 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c048dc0-37b0-43cb-8324-f683332c14de req-a792c1a4-3d15-4886-a61b-e4fec15962f3 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c048dc0-37b0-43cb-8324-f683332c14de req-a792c1a4-3d15-4886-a61b-e4fec15962f3 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-4c048dc0-37b0-43cb-8324-f683332c14de req-a792c1a4-3d15-4886-a61b-e4fec15962f3 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:29 user nova-compute[74429]: WARNING nova.compute.manager [req-4c048dc0-37b0-43cb-8324-f683332c14de req-a792c1a4-3d15-4886-a61b-e4fec15962f3 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state active and task_state rescuing.
Oct 23 20:13:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:13:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:31 user nova-compute[74429]: WARNING nova.compute.manager [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state active and task_state rescuing.
Oct 23 20:13:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:31 user nova-compute[74429]: WARNING nova.compute.manager [req-5c66fefa-3452-4ae4-889d-17c05f04f2a1 req-7c5e45fc-43db-4c69-a8ea-4236bb17b087 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state active and task_state rescuing.
Oct 23 20:13:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6f4012a7-c0f2-4bdc-801d-19e2e26eba6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:13:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:35 user nova-compute[74429]: INFO nova.compute.manager [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Terminating instance
Oct 23 20:13:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:13:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-84d8e7c0-31cf-4b62-8338-86d8b66c72d3 req-b716df3c-bb3c-4557-9b11-26bc18ac75b7 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-unplugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-84d8e7c0-31cf-4b62-8338-86d8b66c72d3 req-b716df3c-bb3c-4557-9b11-26bc18ac75b7 service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-84d8e7c0-31cf-4b62-8338-86d8b66c72d3 req-b716df3c-bb3c-4557-9b11-26bc18ac75b7 service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-84d8e7c0-31cf-4b62-8338-86d8b66c72d3 req-b716df3c-bb3c-4557-9b11-26bc18ac75b7 service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-84d8e7c0-31cf-4b62-8338-86d8b66c72d3 req-b716df3c-bb3c-4557-9b11-26bc18ac75b7 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-unplugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-84d8e7c0-31cf-4b62-8338-86d8b66c72d3 req-b716df3c-bb3c-4557-9b11-26bc18ac75b7 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-unplugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Instance destroyed successfully.
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.objects.instance [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'resources' on Instance uuid b3df83c8-d19c-4eee-b1be-80a2ce516d5c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-827890034',display_name='tempest-ServerActionsTestOtherA-server-547736905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-827890034',id=17,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9EFIfEvl7T4zhPHVD8bG3YLP7Y2gtAz3vSzwgQmnyjokuMyCUhiDI+u0wB4PLqk+yw5AVHydn/wQ8s3JL0iPGqdCzitvGgcY3aPaoJMI2kBK+hU+fei46Dz8tzhSrFQg==',key_name='tempest-keypair-1147496445',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:10:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-lw0j6wag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=b3df83c8-d19c-4eee-b1be-80a2ce516d5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "address": "fa:16:3e:94:2a:28", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1f1772-e8", "ovs_interfaceid": "7e1f1772-e866-4eda-a7aa-d62a94d9f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG os_vif [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e1f1772-e8, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90f3deb8-5366-4239-9620-f572f9d3521b) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:36 user nova-compute[74429]: INFO os_vif [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=7e1f1772-e866-4eda-a7aa-d62a94d9f560,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1f1772-e8')
Oct 23 20:13:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Deleting instance files /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c_del
Oct 23 20:13:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Deletion of /opt/stack/data/nova/instances/b3df83c8-d19c-4eee-b1be-80a2ce516d5c_del complete
Oct 23 20:13:36 user nova-compute[74429]: INFO nova.compute.manager [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 23 20:13:36 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:13:36 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:13:37 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:13:37 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Took 0.88 seconds to deallocate network for instance.
Oct 23 20:13:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7dc4985-7952-422c-a501-afe9a17acfe6 req-7e886823-cec2-4fd1-bffe-cbdbb5cd4b59 service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-deleted-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-5383829d-5fd0-445c-b9be-b1abef126118 req-5b68e961-8518-4621-8594-fc247a54307a service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5383829d-5fd0-445c-b9be-b1abef126118 req-5b68e961-8518-4621-8594-fc247a54307a service nova] Acquiring lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5383829d-5fd0-445c-b9be-b1abef126118 req-5b68e961-8518-4621-8594-fc247a54307a service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5383829d-5fd0-445c-b9be-b1abef126118 req-5b68e961-8518-4621-8594-fc247a54307a service nova] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-5383829d-5fd0-445c-b9be-b1abef126118 req-5b68e961-8518-4621-8594-fc247a54307a service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] No waiting events found dispatching network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:13:38 user nova-compute[74429]: WARNING nova.compute.manager [req-5383829d-5fd0-445c-b9be-b1abef126118 req-5b68e961-8518-4621-8594-fc247a54307a service nova] [instance: b3df83c8-d19c-4eee-b1be-80a2ce516d5c] Received unexpected event network-vif-plugged-7e1f1772-e866-4eda-a7aa-d62a94d9f560 for instance with vm_state deleted and task_state None.
Oct 23 20:13:38 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Deleted allocations for instance b3df83c8-d19c-4eee-b1be-80a2ce516d5c
Oct 23 20:13:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45cd9208-44f4-4ed7-a040-c7effe3c8758 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "b3df83c8-d19c-4eee-b1be-80a2ce516d5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.507s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:13:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:13:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:13:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-changed-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Refreshing instance network info cache due to event network-changed-e4d9ea6a-c873-44ba-93d3-21a5da11c826. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:14:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] Acquiring lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] Acquired lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:05 user nova-compute[74429]: DEBUG nova.network.neutron [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Refreshing network info cache for port e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.network.neutron [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updated VIF entry in instance network info cache for port e4d9ea6a-c873-44ba-93d3-21a5da11c826. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.network.neutron [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28af51cf-56f4-450d-a334-1719d71c4995 req-6e3e775c-f42b-42a9-8034-f8b4d3029988 service nova] Releasing lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "interface-3315b73b-413e-40f2-89bf-e285b13d702a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "interface-3315b73b-413e-40f2-89bf-e285b13d702a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'flavor' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'pci_requests' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.objects.base [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Object Instance<3315b73b-413e-40f2-89bf-e285b13d702a> lazy-loaded attributes: flavor,pci_requests {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG nova.policy [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7120776c404379ad8793a5b357d94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e85b6b40e54b5e81ee9dabef1e6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:14:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Successfully created port: 31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Successfully updated port: 31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquired lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-changed-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Refreshing instance network info cache due to event network-changed-31a6e343-e973-4c7b-b076-78072bac534f. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:14:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] Acquiring lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Releasing lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] Acquired lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.neutron [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Refreshing network info cache for port 31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG os_vif [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f061a699-75b9-5889-acb5-efacbf94caef', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31a6e343-e9, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31a6e343-e9, col_values=(('qos', UUID('db0e5c05-5927-4d7c-80e6-9cda4ef6f8c7')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31a6e343-e9, col_values=(('external_ids', {'iface-id': '31a6e343-e973-4c7b-b076-78072bac534f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:4e:a4', 'vm-uuid': '3315b73b-413e-40f2-89bf-e285b13d702a'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: INFO os_vif [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9')
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] attach device xml: <interface type="ethernet">
Oct 23 20:14:08 user nova-compute[74429]:   <mac address="fa:16:3e:38:4e:a4"/>
Oct 23 20:14:08 user nova-compute[74429]:   <model type="virtio"/>
Oct 23 20:14:08 user nova-compute[74429]:   <mtu size="1442"/>
Oct 23 20:14:08 user nova-compute[74429]:   <target dev="tap31a6e343-e9"/>
Oct 23 20:14:08 user nova-compute[74429]: </interface>
Oct 23 20:14:08 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.neutron [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updated VIF entry in instance network info cache for port 31a6e343-e973-4c7b-b076-78072bac534f. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG nova.network.neutron [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-82a5a152-89f7-4b75-9930-9af5b4efbad2 req-edfc9832-7f69-4f36-b716-757f98f1c0dd service nova] Releasing lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No BDM found with device name hda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No VIF found with MAC fa:16:3e:72:6c:0a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:14:09 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:14:09 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:14:09 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:14:09</nova:creationTime>
Oct 23 20:14:09 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:14:09 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:14:09 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:14:09 user nova-compute[74429]:   <nova:owner>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:14:09 user nova-compute[74429]:   </nova:owner>
Oct 23 20:14:09 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:14:09 user nova-compute[74429]:   <nova:ports>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:14:09 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:14:09 user nova-compute[74429]:     </nova:port>
Oct 23 20:14:09 user nova-compute[74429]:     <nova:port uuid="31a6e343-e973-4c7b-b076-78072bac534f">
Oct 23 20:14:09 user nova-compute[74429]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Oct 23 20:14:09 user nova-compute[74429]:     </nova:port>
Oct 23 20:14:09 user nova-compute[74429]:   </nova:ports>
Oct 23 20:14:09 user nova-compute[74429]: </nova:instance>
Oct 23 20:14:09 user nova-compute[74429]:  {{(pid=74429) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5be9166f-e1d3-400b-baf2-5e19b9efaee7 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "interface-3315b73b-413e-40f2-89bf-e285b13d702a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.985s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'flavor' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:09 user nova-compute[74429]: INFO nova.compute.manager [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Attaching volume a8c82f54-e6bf-44b4-9cc7-8029dc461df4 to /dev/vdb
Oct 23 20:14:09 user nova-compute[74429]: DEBUG os_brick.utils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[79154ad9-b7ac-483d-8435-f4543498963b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd24d78e-70ec-43ff-b250-f0dd2714fcd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15fb13-6eca-4a24-8685-0d49a9456c7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6351b4cf-793e-48b3-9a75-58a78d932c71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:14:09 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c7d41c-26d2-4754-93a4-af4da724014a]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG os_brick.utils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating existing volume attachment record: c1180110-7676-4df2-8e83-ae0a38a78636 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:09 user nova-compute[74429]: WARNING nova.compute.manager [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f for instance with vm_state active and task_state None.
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:09 user nova-compute[74429]: WARNING nova.compute.manager [req-054237b9-080f-42b4-a33a-72ed14996995 req-5fdebabd-1c68-46cb-9a03-a8938810e596 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f for instance with vm_state active and task_state None.
Oct 23 20:14:11 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquired lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:14:11 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'info_cache' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:11 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Releasing lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:12 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance destroyed successfully.
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'resources' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG os_vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ec5a03-70, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93940d2e-54a3-49de-b087-faf7823b0090) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:12 user nova-compute[74429]: INFO os_vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70')
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start _get_guest_xml network_info=[{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'numa_topology' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:12 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:12 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'vcpu_model' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'pci_devices' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:14:12 user nova-compute[74429]:   <uuid>236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</uuid>
Oct 23 20:14:12 user nova-compute[74429]:   <name>instance-00000010</name>
Oct 23 20:14:12 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:14:12 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:14:12 user nova-compute[74429]:   <metadata>
Oct 23 20:14:12 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:14:12 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:14:12 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeTestJSON-server-2118326004</nova:name>
Oct 23 20:14:12 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:14:12</nova:creationTime>
Oct 23 20:14:12 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:14:12 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:14:12 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:14:12 user nova-compute[74429]:       <nova:owner>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:user uuid="9ce4aa1886f044d3bb7c952632b48047">tempest-AttachVolumeTestJSON-1733625309-project-member</nova:user>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:project uuid="f4121e72c37c4fa5acfd0f568fc1153d">tempest-AttachVolumeTestJSON-1733625309</nova:project>
Oct 23 20:14:12 user nova-compute[74429]:       </nova:owner>
Oct 23 20:14:12 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:14:12 user nova-compute[74429]:       <nova:ports>
Oct 23 20:14:12 user nova-compute[74429]:         <nova:port uuid="d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee">
Oct 23 20:14:12 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:14:12 user nova-compute[74429]:         </nova:port>
Oct 23 20:14:12 user nova-compute[74429]:       </nova:ports>
Oct 23 20:14:12 user nova-compute[74429]:     </nova:instance>
Oct 23 20:14:12 user nova-compute[74429]:   </metadata>
Oct 23 20:14:12 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:14:12 user nova-compute[74429]:     <system>
Oct 23 20:14:12 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:14:12 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:14:12 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:14:12 user nova-compute[74429]:       <entry name="serial">236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</entry>
Oct 23 20:14:12 user nova-compute[74429]:       <entry name="uuid">236ad665-9dd8-4cb3-85cd-35f1b6a26b3a</entry>
Oct 23 20:14:12 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:14:12 user nova-compute[74429]:     </system>
Oct 23 20:14:12 user nova-compute[74429]:   </sysinfo>
Oct 23 20:14:12 user nova-compute[74429]:   <os>
Oct 23 20:14:12 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:14:12 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:14:12 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:14:12 user nova-compute[74429]:   </os>
Oct 23 20:14:12 user nova-compute[74429]:   <features>
Oct 23 20:14:12 user nova-compute[74429]:     <acpi/>
Oct 23 20:14:12 user nova-compute[74429]:     <apic/>
Oct 23 20:14:12 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:14:12 user nova-compute[74429]:   </features>
Oct 23 20:14:12 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:14:12 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:14:12 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:14:12 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:14:12 user nova-compute[74429]:   </clock>
Oct 23 20:14:12 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:14:12 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:14:12 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:14:12 user nova-compute[74429]:   </cpu>
Oct 23 20:14:12 user nova-compute[74429]:   <devices>
Oct 23 20:14:12 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:14:12 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:14:12 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk"/>
Oct 23 20:14:12 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:14:12 user nova-compute[74429]:     </disk>
Oct 23 20:14:12 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:14:12 user nova-compute[74429]:       <mac address="fa:16:3e:88:c1:97"/>
Oct 23 20:14:12 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:14:12 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:14:12 user nova-compute[74429]:       <target dev="tapd0ec5a03-70"/>
Oct 23 20:14:12 user nova-compute[74429]:     </interface>
Oct 23 20:14:12 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:14:12 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/console.log" append="off"/>
Oct 23 20:14:12 user nova-compute[74429]:     </serial>
Oct 23 20:14:12 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:14:12 user nova-compute[74429]:     <video>
Oct 23 20:14:12 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:14:12 user nova-compute[74429]:     </video>
Oct 23 20:14:12 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:14:12 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:14:12 user nova-compute[74429]:     </rng>
Oct 23 20:14:12 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:14:12 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:14:12 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:14:12 user nova-compute[74429]:     </memballoon>
Oct 23 20:14:12 user nova-compute[74429]:   </devices>
Oct 23 20:14:12 user nova-compute[74429]: </domain>
Oct 23 20:14:12 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'trusted_certs' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:14:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Cannot resize image /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'migration_context' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.objects.base [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Object Instance<236ad665-9dd8-4cb3-85cd-35f1b6a26b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7019e352-a2a1-59a7-9760-30d3412da451', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ec5a03-70, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ec5a03-70, col_values=(('qos', UUID('eda89582-9691-43db-a67b-a404234b8b8f')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ec5a03-70, col_values=(('external_ids', {'iface-id': 'd0ec5a03-7054-4e1a-9b13-cb5b0f5862ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c1:97', 'vm-uuid': '236ad665-9dd8-4cb3-85cd-35f1b6a26b3a'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: INFO os_vif [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70')
Oct 23 20:14:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:13 user nova-compute[74429]: INFO nova.compute.manager [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Unshelving
Oct 23 20:14:13 user nova-compute[74429]: INFO nova.virt.block_device [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Booting with volume 70ef0a13-d89b-44f4-822b-1cd41dadc596 at /dev/vda
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_brick.utils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc46b8d-d0c3-4967-b8c4-c108a6edac71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d863ac-cad6-4629-8166-2f1840810b32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c7a57-3e45-42a1-9efe-088a31802c5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[08801637-ce71-4030-8196-b6f920f03fab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:14:13 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:14:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd6afcd-b783-4976-b508-9dcb1b2e08f3]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG os_brick.utils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:13 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating existing volume attachment record: 44553fd4-3434-4977-91d6-5324dd61a554 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-b7abfad7-735f-44bb-bb22-59fb9b695ac5 req-d6ed1ded-2f12-4459-b390-6d55288f0a6f service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7abfad7-735f-44bb-bb22-59fb9b695ac5 req-d6ed1ded-2f12-4459-b390-6d55288f0a6f service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7abfad7-735f-44bb-bb22-59fb9b695ac5 req-d6ed1ded-2f12-4459-b390-6d55288f0a6f service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b7abfad7-735f-44bb-bb22-59fb9b695ac5 req-d6ed1ded-2f12-4459-b390-6d55288f0a6f service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-b7abfad7-735f-44bb-bb22-59fb9b695ac5 req-d6ed1ded-2f12-4459-b390-6d55288f0a6f service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:14 user nova-compute[74429]: WARNING nova.compute.manager [req-b7abfad7-735f-44bb-bb22-59fb9b695ac5 req-d6ed1ded-2f12-4459-b390-6d55288f0a6f service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state powering-on.
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:15 user nova-compute[74429]: INFO nova.compute.manager [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Terminating instance
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-c693d879-4f87-4fcd-b142-88b5efb1a482 req-d846a70d-22ce-466e-8485-8bd2bdf831f3 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c693d879-4f87-4fcd-b142-88b5efb1a482 req-d846a70d-22ce-466e-8485-8bd2bdf831f3 service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c693d879-4f87-4fcd-b142-88b5efb1a482 req-d846a70d-22ce-466e-8485-8bd2bdf831f3 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c693d879-4f87-4fcd-b142-88b5efb1a482 req-d846a70d-22ce-466e-8485-8bd2bdf831f3 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-c693d879-4f87-4fcd-b142-88b5efb1a482 req-d846a70d-22ce-466e-8485-8bd2bdf831f3 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-c693d879-4f87-4fcd-b142-88b5efb1a482 req-d846a70d-22ce-466e-8485-8bd2bdf831f3 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-unplugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Instance destroyed successfully.
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.objects.instance [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'resources' on Instance uuid 9901998c-ee34-4de9-b819-bc6c23bdfcdd {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1843622581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1843622581',id=11,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-n3ca9kmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:07:49Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=9901998c-ee34-4de9-b819-bc6c23bdfcdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "de2fe581-050a-4bab-aec1-15928e24366b", "address": "fa:16:3e:e9:c8:13", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde2fe581-05", "ovs_interfaceid": "de2fe581-050a-4bab-aec1-15928e24366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG os_vif [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde2fe581-05, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2403f8d-3fee-4ae3-a4af-808335c6c890) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:15 user nova-compute[74429]: INFO os_vif [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c8:13,bridge_name='br-int',has_traffic_filtering=True,id=de2fe581-050a-4bab-aec1-15928e24366b,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde2fe581-05')
Oct 23 20:14:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzLDEqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:15 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f9370-f953-4af6-9d2a-e54284de8db5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:14:16 user nova-compute[74429]: No targets found.
Oct 23 20:14:16 user nova-compute[74429]: iSNS:
Oct 23 20:14:16 user nova-compute[74429]: No targets found.
Oct 23 20:14:16 user nova-compute[74429]: STATIC:
Oct 23 20:14:16 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658
Oct 23 20:14:16 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:14:16 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:14:16 user nova-compute[74429]: FIRMWARE:
Oct 23 20:14:16 user nova-compute[74429]: No targets found.
Oct 23 20:14:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:14:16 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:14:16 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4979803a-3f9d-475d-b922-8de336229189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[40da9572-2d4e-4464-b281-294b80fd7f61]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:14:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 (non-flash)
Oct 23 20:14:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50452f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658'): ({'sdi'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Removing single pathed devices sdi {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea17aba-e451-4216-bbba-a04cb172cb06]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd5e67d-2f40-4f60-85b3-e90a941f9930]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Flushing IO for device /dev/sdi {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1167b857-27e1-4991-939a-fda6d3fcf486]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc5c788-9db4-4bac-93a7-47ce6767e255]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] SCSI volumes sdi have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea264758-ccfb-408b-9154-3e3799157ed3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d8c26e-4a98-40bc-8575-b579b6bef8c4]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260]
Oct 23 20:14:16 user nova-compute[74429]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658, portal: 172.16.0.220,3260] successful.
Oct 23 20:14:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7fb1f1-09e6-457f-8f31-1c3aff0a5658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d2e50-d192-42b7-b5c4-e02f7405cf67]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] <== disconnect_volume: return (287ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:14:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Deleting instance files /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd_del
Oct 23 20:14:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Deletion of /opt/stack/data/nova/instances/9901998c-ee34-4de9-b819-bc6c23bdfcdd_del complete
Oct 23 20:14:16 user nova-compute[74429]: INFO nova.compute.manager [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-a8d44913-09ef-4a04-ab93-0dc852f90555 req-2bd7ee29-3aef-4682-ad88-49557b9a20c7 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a8d44913-09ef-4a04-ab93-0dc852f90555 req-2bd7ee29-3aef-4682-ad88-49557b9a20c7 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a8d44913-09ef-4a04-ab93-0dc852f90555 req-2bd7ee29-3aef-4682-ad88-49557b9a20c7 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a8d44913-09ef-4a04-ab93-0dc852f90555 req-2bd7ee29-3aef-4682-ad88-49557b9a20c7 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-a8d44913-09ef-4a04-ab93-0dc852f90555 req-2bd7ee29-3aef-4682-ad88-49557b9a20c7 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:16 user nova-compute[74429]: WARNING nova.compute.manager [req-a8d44913-09ef-4a04-ab93-0dc852f90555 req-2bd7ee29-3aef-4682-ad88-49557b9a20c7 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state stopped and task_state powering-on.
Oct 23 20:14:16 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Took 0.43 seconds to deallocate network for instance.
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:14:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance rebooted successfully.
Oct 23 20:14:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b174cb78-28a4-4f06-95dc-e755927d9e4e tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:14:17 user nova-compute[74429]: INFO nova.compute.manager [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Took 0.85 seconds to detach 1 volumes for instance.
Oct 23 20:14:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] Acquiring lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] No waiting events found dispatching network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:17 user nova-compute[74429]: WARNING nova.compute.manager [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received unexpected event network-vif-plugged-de2fe581-050a-4bab-aec1-15928e24366b for instance with vm_state deleted and task_state None.
Oct 23 20:14:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-ecc98bc6-f5a3-4c56-b606-6cf9933732cb req-2ba09cd1-61a6-428e-b513-ea04428663c6 service nova] [instance: 9901998c-ee34-4de9-b819-bc6c23bdfcdd] Received event network-vif-deleted-de2fe581-050a-4bab-aec1-15928e24366b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:17 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:14:18 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:14:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:18 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Deleted allocations for instance 9901998c-ee34-4de9-b819-bc6c23bdfcdd
Oct 23 20:14:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-14be0849-8936-4e9b-ba73-7250f5e1773e tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "9901998c-ee34-4de9-b819-bc6c23bdfcdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:19 user nova-compute[74429]: INFO nova.compute.manager [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Unshelving
Oct 23 20:14:19 user nova-compute[74429]: INFO nova.virt.block_device [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Booting with volume 9fa6a87d-7aa3-4536-88b3-6c75c6a68816 at /dev/vdc
Oct 23 20:14:19 user nova-compute[74429]: DEBUG os_brick.utils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[963089fe-a8de-4f70-ae46-908e3d17d806]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88b51c-fa3d-431b-8231-512db962ef75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[28827c54-1ab5-4335-b78a-874ca63a2744]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d3c19-7d9b-40d4-a365-f58799348aa7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:14:19 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:14:19 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c794d-a397-4de9-a0c7-10fb1054e7eb]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG os_brick.utils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:19 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating existing volume attachment record: 92bdf0a7-9116-447b-bd3d-1cb5bd952e9a {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:25 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7902MB free_disk=25.266029357910156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance dc41e78e-050f-429e-b0b9-f4473a07c2c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 3315b73b-413e-40f2-89bf-e285b13d702a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance e50c5c04-932e-4202-b660-bfbcedd2695e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5b24653c-f35e-4aec-aa2c-d6cfd7616235 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance de91660d-61a1-4e58-a75d-8fed5386b6de has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:14:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [{"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:14:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:14:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:34 user nova-compute[74429]: INFO nova.compute.manager [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Terminating instance
Oct 23 20:14:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-2554a538-0eb4-491c-a62c-c78863fbb958 req-45ee0596-b4e7-4953-bb97-29238323676a service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-vif-unplugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2554a538-0eb4-491c-a62c-c78863fbb958 req-45ee0596-b4e7-4953-bb97-29238323676a service nova] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2554a538-0eb4-491c-a62c-c78863fbb958 req-45ee0596-b4e7-4953-bb97-29238323676a service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2554a538-0eb4-491c-a62c-c78863fbb958 req-45ee0596-b4e7-4953-bb97-29238323676a service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-2554a538-0eb4-491c-a62c-c78863fbb958 req-45ee0596-b4e7-4953-bb97-29238323676a service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] No waiting events found dispatching network-vif-unplugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-2554a538-0eb4-491c-a62c-c78863fbb958 req-45ee0596-b4e7-4953-bb97-29238323676a service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-vif-unplugged-82becb71-3f29-437d-926b-67fa1f5389a0 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Instance destroyed successfully.
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.objects.instance [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lazy-loading 'resources' on Instance uuid e50c5c04-932e-4202-b660-bfbcedd2695e {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-377453610',display_name='tempest-ServersNegativeTestJSON-server-377453610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-377453610',id=28,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7f5bd02ac3b49d8b904b56e2e89eeef',ramdisk_id='',reservation_id='r-mmpldq0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-254346405',owner_user_name='tempest-ServersNegativeTestJSON-254346405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:50Z,user_data=None,user_id='6161756c0a9a4f6ba7a319801ba19818',uuid=e50c5c04-932e-4202-b660-bfbcedd2695e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converting VIF {"id": "82becb71-3f29-437d-926b-67fa1f5389a0", "address": "fa:16:3e:4b:48:bf", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82becb71-3f", "ovs_interfaceid": "82becb71-3f29-437d-926b-67fa1f5389a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG os_vif [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82becb71-3f, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=008409d8-88db-4ff7-bb00-114d91bf2837) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:35 user nova-compute[74429]: INFO os_vif [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:48:bf,bridge_name='br-int',has_traffic_filtering=True,id=82becb71-3f29-437d-926b-67fa1f5389a0,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82becb71-3f')
Oct 23 20:14:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Deleting instance files /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e_del
Oct 23 20:14:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Deletion of /opt/stack/data/nova/instances/e50c5c04-932e-4202-b660-bfbcedd2695e_del complete
Oct 23 20:14:35 user nova-compute[74429]: INFO nova.compute.manager [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Took 0.64 seconds to destroy the instance on the hypervisor.
Oct 23 20:14:35 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:35 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Took 0.45 seconds to deallocate network for instance.
Oct 23 20:14:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-6acbacdc-9f2c-4e03-b0a0-58b979462984 req-ffc87817-bc38-4d66-815f-56b25bf0fda6 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-vif-deleted-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:36 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Deleted allocations for instance e50c5c04-932e-4202-b660-bfbcedd2695e
Oct 23 20:14:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-47f196d6-5ae0-4dfa-8af2-8cfce2510bb4 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.560s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'pci_requests' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'numa_topology' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:36 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:14:36 user nova-compute[74429]: INFO nova.compute.claims [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Claim successful on node user
Oct 23 20:14:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-431e155d-63eb-47a4-bb71-5e42d619ae51 req-a4274e62-c30b-4f88-a3b1-4d1d886749f3 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received event network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-431e155d-63eb-47a4-bb71-5e42d619ae51 req-a4274e62-c30b-4f88-a3b1-4d1d886749f3 service nova] Acquiring lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-431e155d-63eb-47a4-bb71-5e42d619ae51 req-a4274e62-c30b-4f88-a3b1-4d1d886749f3 service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-431e155d-63eb-47a4-bb71-5e42d619ae51 req-a4274e62-c30b-4f88-a3b1-4d1d886749f3 service nova] Lock "e50c5c04-932e-4202-b660-bfbcedd2695e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-431e155d-63eb-47a4-bb71-5e42d619ae51 req-a4274e62-c30b-4f88-a3b1-4d1d886749f3 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] No waiting events found dispatching network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:37 user nova-compute[74429]: WARNING nova.compute.manager [req-431e155d-63eb-47a4-bb71-5e42d619ae51 req-a4274e62-c30b-4f88-a3b1-4d1d886749f3 service nova] [instance: e50c5c04-932e-4202-b660-bfbcedd2695e] Received unexpected event network-vif-plugged-82becb71-3f29-437d-926b-67fa1f5389a0 for instance with vm_state deleted and task_state None.
Oct 23 20:14:37 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:14:37 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:14:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:37 user nova-compute[74429]: INFO nova.network.neutron [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating port 7a399db8-c2da-4bd4-84a1-37a1155a1912 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing instance network info cache due to event network-changed-7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] Acquiring lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.network.neutron [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:14:38 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Creating image(s)
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'trusted_certs' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] Acquired lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.network.neutron [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Refreshing network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG nova.objects.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<de91660d-61a1-4e58-a75d-8fed5386b6de> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "ca18db206600093a0abacb15b4c872771fe08b11" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "ca18db206600093a0abacb15b4c872771fe08b11" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG nova.virt.images [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] 4ee0fbbf-0b5c-4ab5-b320-ed534f974d49 was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.part /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG nova.network.neutron [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updated VIF entry in instance network info cache for port 7a399db8-c2da-4bd4-84a1-37a1155a1912. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG nova.network.neutron [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-977e704a-dd0c-4dc8-8fe7-b223aaf43022 req-591d73c6-6d02-43cb-bd20-88f8e59b7ce8 service nova] Releasing lock "refresh_cache-de91660d-61a1-4e58-a75d-8fed5386b6de" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.part /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.converted" returned: 0 in 0.491s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "ca18db206600093a0abacb15b4c872771fe08b11" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.044s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "ca18db206600093a0abacb15b4c872771fe08b11" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "ca18db206600093a0abacb15b4c872771fe08b11" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11,backing_fmt=raw /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11,backing_fmt=raw /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk 1073741824" returned: 0 in 0.047s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "ca18db206600093a0abacb15b4c872771fe08b11" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'migration_context' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG nova.objects.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<de91660d-61a1-4e58-a75d-8fed5386b6de> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:41 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Rebasing disk image.
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d -F raw /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d -F raw /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk" returned: 0 in 2.082s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Ensure instance console log exists: /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Start _get_guest_xml network_info=[{"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ca874ec57b3fdf3ca7db8337ac388698',container_format='bare',created_at=2023-10-23T20:12:27Z,direct_url=<?>,disk_format='qcow2',id=4ee0fbbf-0b5c-4ab5-b320-ed534f974d49,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-484815685-shelved',owner='e35bb75b1bd846e6ac415aaefd410621',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T20:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '92bdf0a7-9116-447b-bd3d-1cb5bd952e9a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmAFGCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'de91660d-61a1-4e58-a75d-8fed5386b6de', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa6a87d-7aa3-4536-88b3-6c75c6a68816', 'serial': '9fa6a87d-7aa3-4536-88b3-6c75c6a68816'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:14:43 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:43 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ca874ec57b3fdf3ca7db8337ac388698',container_format='bare',created_at=2023-10-23T20:12:27Z,direct_url=<?>,disk_format='qcow2',id=4ee0fbbf-0b5c-4ab5-b320-ed534f974d49,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-484815685-shelved',owner='e35bb75b1bd846e6ac415aaefd410621',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T20:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'vcpu_model' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.objects.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<de91660d-61a1-4e58-a75d-8fed5386b6de> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmAFGCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:43 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:43 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:43 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea14668-f1d5-4284-b38c-7aacafe68c90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:14:43 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf288943-1754-42a1-98a7-4674eaabbd2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816] added
Oct 23 20:14:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c850bfa-7b03-46b3-8f91-55f40b36a836]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe34a7da-55f9-4c22-9374-e7889465d754]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRmAFGCN {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRmAFGCN" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0983595e-49f9-4431-99fb-2c2341ee0f64]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRmAFGCN'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[84681a89-397e-44f6-89c5-64573e09628b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad0890-52e5-4ca6-a683-ae85f30cac9f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:14:43 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:14:43 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:43 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:14:43 user nova-compute[74429]: 
Oct 23 20:14:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bb289f-bd68-421f-bddf-ae11fde6930d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260]
Oct 23 20:14:44 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260] successful.
Oct 23 20:14:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0980d3-15aa-4f0b-ac64-e68ccbcf70d2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f447b182-5129-4d3a-b510-d188d9d9e37b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865d088-652e-4fdf-bc5b-c752e297f715]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmAFGCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPzhZjEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:44 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:14:44 user nova-compute[74429]: INFO nova.compute.claims [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Claim successful on node user
Oct 23 20:14:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:14:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:45 user nova-compute[74429]: INFO nova.network.neutron [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating port fac1362d-5d37-445e-9987-b454e179e242 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26437633235333066', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437633235333066', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.774s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:45 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[05342889-eda3-4e89-876a-fd67d506c30b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:14:45 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-484815685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-484815685',id=24,image_ref='4ee0fbbf-0b5c-4ab5-b320-ed534f974d49',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-383380181',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-xfgweb4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member',shelved_at='2023-10-23T20:12:32.078187',shelved_host='user',shelved_image_id='4ee0fbbf-0b5c-4ab5-b320-ed534f974d49'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=de91660d-61a1-4e58-a75d-8fed5386b6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'pci_devices' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f70a2-8ce6-4035-a060-b2326145fd69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4] added
Oct 23 20:14:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.objects.base [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<de91660d-61a1-4e58-a75d-8fed5386b6de> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:14:45 user nova-compute[74429]:   <uuid>de91660d-61a1-4e58-a75d-8fed5386b6de</uuid>
Oct 23 20:14:45 user nova-compute[74429]:   <name>instance-00000018</name>
Oct 23 20:14:45 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:14:45 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:14:45 user nova-compute[74429]:   <metadata>
Oct 23 20:14:45 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:14:45 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:14:45 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-484815685</nova:name>
Oct 23 20:14:45 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:14:43</nova:creationTime>
Oct 23 20:14:45 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:14:45 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:14:45 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:14:45 user nova-compute[74429]:       <nova:owner>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:user uuid="213b96dfb6b043aabcebdd6710ae8f4c">tempest-AttachVolumeShelveTestJSON-301170821-project-member</nova:user>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:project uuid="e35bb75b1bd846e6ac415aaefd410621">tempest-AttachVolumeShelveTestJSON-301170821</nova:project>
Oct 23 20:14:45 user nova-compute[74429]:       </nova:owner>
Oct 23 20:14:45 user nova-compute[74429]:       <nova:root type="image" uuid="4ee0fbbf-0b5c-4ab5-b320-ed534f974d49"/>
Oct 23 20:14:45 user nova-compute[74429]:       <nova:ports>
Oct 23 20:14:45 user nova-compute[74429]:         <nova:port uuid="7a399db8-c2da-4bd4-84a1-37a1155a1912">
Oct 23 20:14:45 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:14:45 user nova-compute[74429]:         </nova:port>
Oct 23 20:14:45 user nova-compute[74429]:       </nova:ports>
Oct 23 20:14:45 user nova-compute[74429]:     </nova:instance>
Oct 23 20:14:45 user nova-compute[74429]:   </metadata>
Oct 23 20:14:45 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:14:45 user nova-compute[74429]:     <system>
Oct 23 20:14:45 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:14:45 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:14:45 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:14:45 user nova-compute[74429]:       <entry name="serial">de91660d-61a1-4e58-a75d-8fed5386b6de</entry>
Oct 23 20:14:45 user nova-compute[74429]:       <entry name="uuid">de91660d-61a1-4e58-a75d-8fed5386b6de</entry>
Oct 23 20:14:45 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:14:45 user nova-compute[74429]:     </system>
Oct 23 20:14:45 user nova-compute[74429]:   </sysinfo>
Oct 23 20:14:45 user nova-compute[74429]:   <os>
Oct 23 20:14:45 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:14:45 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:14:45 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:14:45 user nova-compute[74429]:   </os>
Oct 23 20:14:45 user nova-compute[74429]:   <features>
Oct 23 20:14:45 user nova-compute[74429]:     <acpi/>
Oct 23 20:14:45 user nova-compute[74429]:     <apic/>
Oct 23 20:14:45 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:14:45 user nova-compute[74429]:   </features>
Oct 23 20:14:45 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:14:45 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:14:45 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:14:45 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:14:45 user nova-compute[74429]:   </clock>
Oct 23 20:14:45 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:14:45 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:14:45 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:14:45 user nova-compute[74429]:   </cpu>
Oct 23 20:14:45 user nova-compute[74429]:   <devices>
Oct 23 20:14:45 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:14:45 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:14:45 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk"/>
Oct 23 20:14:45 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:14:45 user nova-compute[74429]:     </disk>
Oct 23 20:14:45 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:14:45 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:14:45 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:14:45 user nova-compute[74429]:       <target dev="vdc" bus="virtio"/>
Oct 23 20:14:45 user nova-compute[74429]:       <serial>9fa6a87d-7aa3-4536-88b3-6c75c6a68816</serial>
Oct 23 20:14:45 user nova-compute[74429]:     </disk>
Oct 23 20:14:45 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:14:45 user nova-compute[74429]:       <mac address="fa:16:3e:16:e2:c8"/>
Oct 23 20:14:45 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:14:45 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:14:45 user nova-compute[74429]:       <target dev="tap7a399db8-c2"/>
Oct 23 20:14:45 user nova-compute[74429]:     </interface>
Oct 23 20:14:45 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:14:45 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/console.log" append="off"/>
Oct 23 20:14:45 user nova-compute[74429]:     </serial>
Oct 23 20:14:45 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:14:45 user nova-compute[74429]:     <video>
Oct 23 20:14:45 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:14:45 user nova-compute[74429]:     </video>
Oct 23 20:14:45 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:14:45 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:14:45 user nova-compute[74429]:     </rng>
Oct 23 20:14:45 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:14:45 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:14:45 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:14:45 user nova-compute[74429]:     </memballoon>
Oct 23 20:14:45 user nova-compute[74429]:   </devices>
Oct 23 20:14:45 user nova-compute[74429]: </domain>
Oct 23 20:14:45 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-484815685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-484815685',id=24,image_ref='4ee0fbbf-0b5c-4ab5-b320-ed534f974d49',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-383380181',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-xfgweb4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member',shelved_at='2023-10-23T20:12:32.078187',shelved_host='user',shelved_image_id='4ee0fbbf-0b5c-4ab5-b320-ed534f974d49'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=de91660d-61a1-4e58-a75d-8fed5386b6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_vif [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3adbc-a0d0-4f2e-97ef-b110d1b13d4d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff382fb9-d0d1-5c38-8bfe-766346bcdd70', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a399db8-c2, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a399db8-c2, col_values=(('qos', UUID('4b9f81cc-95bc-4ec1-99d7-4cfccdb8b000')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a399db8-c2, col_values=(('external_ids', {'iface-id': '7a399db8-c2da-4bd4-84a1-37a1155a1912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:e2:c8', 'vm-uuid': 'de91660d-61a1-4e58-a75d-8fed5386b6de'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[745834a8-2e3b-493c-8630-c4b3e5bcceb2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPzhZjEX {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:45 user nova-compute[74429]: INFO os_vif [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2')
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPzhZjEX" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d072763c-de8b-441d-ba1f-77d9c6f15af1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xPzhZjEX'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ec4ee-ea2f-415a-916e-1ec54527bb5a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No VIF found with MAC fa:16:3e:16:e2:c8, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa082dca-c06b-4209-9b20-1fe2d240991e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cf15fb-2721-44c5-b699-1dab2c12c37a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260]
Oct 23 20:14:45 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260] successful.
Oct 23 20:14:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568d280-5156-44e8-88f8-de824281e5b5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4671e1ed-157e-424b-80a9-2ca1c1f5b39a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:45 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:14:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:45 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:14:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8079d12-b72b-4eca-8800-a8ef336b0316]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-changed-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing instance network info cache due to event network-changed-fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:14:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:14:46 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Creating image(s)
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Ensure instance console log exists: /opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Start _get_guest_xml network_info=[{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '44553fd4-3434-4977-91d6-5324dd61a554', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b24653c-f35e-4aec-aa2c-d6cfd7616235', 'attached_at': '', 'detached_at': '', 'volume_id': '70ef0a13-d89b-44f4-822b-1cd41dadc596', 'serial': '70ef0a13-d89b-44f4-822b-1cd41dadc596'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing network info cache for port fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:14:46 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:46 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.objects.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Object Instance<5b24653c-f35e-4aec-aa2c-d6cfd7616235> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:14:46 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPzhZjEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] <== connect_volume: return (2172ms) {'type': 'block', 'scsi_wwn': '23437353739303163', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353739303163', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.014s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:46 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:14:46 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'flavor' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea59cda-39c0-4a5f-9148-b487e967c820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:14:46 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:14:46 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:14:46 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:14:46 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:14:46 user nova-compute[74429]:   <serial>a8c82f54-e6bf-44b4-9cc7-8029dc461df4</serial>
Oct 23 20:14:46 user nova-compute[74429]: </disk>
Oct 23 20:14:46 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ffbbb-9bfb-4c46-978a-29fd41fe5af5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596] added
Oct 23 20:14:46 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8531a559-f68c-43ee-83a4-8c506aae0f36]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2863a8-9129-4bd6-9102-e37d832b6e85]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCkMEvUN {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCkMEvUN" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0008d3f-046c-40d2-91bd-52e86f980e49]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCkMEvUN'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3184e69d-9c59-4b65-9594-d84b87b0f798]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc2226-3e93-4e22-a073-254344c891dc]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ebc3ac-cdd9-4c89-ba9c-0db9e603238b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]
Oct 23 20:14:46 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.
Oct 23 20:14:46 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updated VIF entry in instance network info cache for port fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8993be1-1b7c-40e3-9ad0-ec502ad7508d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20df38-3ee8-4f63-ba67-cd7188fcea45]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:14:46 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5996bc0-7764-42c2-8b7d-523a382d6c32]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:14:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4e87ed75-8599-4b3a-8b5d-687d4b170af6 req-c15e797d-7614-4426-af53-3488c99a2db3 service nova] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-d0277b03-b62f-4fa2-8e73-65cfaf282993 req-aa4b410b-1f45-47b2-a705-6816823d0b2c service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d0277b03-b62f-4fa2-8e73-65cfaf282993 req-aa4b410b-1f45-47b2-a705-6816823d0b2c service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d0277b03-b62f-4fa2-8e73-65cfaf282993 req-aa4b410b-1f45-47b2-a705-6816823d0b2c service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d0277b03-b62f-4fa2-8e73-65cfaf282993 req-aa4b410b-1f45-47b2-a705-6816823d0b2c service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-d0277b03-b62f-4fa2-8e73-65cfaf282993 req-aa4b410b-1f45-47b2-a705-6816823d0b2c service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:47 user nova-compute[74429]: WARNING nova.compute.manager [req-d0277b03-b62f-4fa2-8e73-65cfaf282993 req-aa4b410b-1f45-47b2-a705-6816823d0b2c service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No BDM found with device name hda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] No VIF found with MAC fa:16:3e:72:6c:0a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c882faa-63d4-4881-b6ae-3b0db160bcea tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.719s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26234336331366238', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234336331366238', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-324355928',display_name='tempest-TestShelveInstance-server-324355928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-324355928',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1295653859',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d4a64891d474410aacce30e403d2f625',ramdisk_id='',reservation_id='r-yngx7jwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1011766138',owner_user_name='tempest-TestShelveInstance-1011766138-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:14:14Z,user_data=None,user_id='da9987f7f5024cb2b0094f1efd8fc942',uuid=5b24653c-f35e-4aec-aa2c-d6cfd7616235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converting VIF {"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.objects.base [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Object Instance<5b24653c-f35e-4aec-aa2c-d6cfd7616235> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:14:47 user nova-compute[74429]:   <uuid>5b24653c-f35e-4aec-aa2c-d6cfd7616235</uuid>
Oct 23 20:14:47 user nova-compute[74429]:   <name>instance-00000017</name>
Oct 23 20:14:47 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:14:47 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:14:47 user nova-compute[74429]:   <metadata>
Oct 23 20:14:47 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:14:47 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:14:47 user nova-compute[74429]:       <nova:name>tempest-TestShelveInstance-server-324355928</nova:name>
Oct 23 20:14:47 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:14:46</nova:creationTime>
Oct 23 20:14:47 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:14:47 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:14:47 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:14:47 user nova-compute[74429]:       <nova:owner>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:user uuid="da9987f7f5024cb2b0094f1efd8fc942">tempest-TestShelveInstance-1011766138-project-member</nova:user>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:project uuid="d4a64891d474410aacce30e403d2f625">tempest-TestShelveInstance-1011766138</nova:project>
Oct 23 20:14:47 user nova-compute[74429]:       </nova:owner>
Oct 23 20:14:47 user nova-compute[74429]:       <nova:ports>
Oct 23 20:14:47 user nova-compute[74429]:         <nova:port uuid="fac1362d-5d37-445e-9987-b454e179e242">
Oct 23 20:14:47 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 20:14:47 user nova-compute[74429]:         </nova:port>
Oct 23 20:14:47 user nova-compute[74429]:       </nova:ports>
Oct 23 20:14:47 user nova-compute[74429]:     </nova:instance>
Oct 23 20:14:47 user nova-compute[74429]:   </metadata>
Oct 23 20:14:47 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:14:47 user nova-compute[74429]:     <system>
Oct 23 20:14:47 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:14:47 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:14:47 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:14:47 user nova-compute[74429]:       <entry name="serial">5b24653c-f35e-4aec-aa2c-d6cfd7616235</entry>
Oct 23 20:14:47 user nova-compute[74429]:       <entry name="uuid">5b24653c-f35e-4aec-aa2c-d6cfd7616235</entry>
Oct 23 20:14:47 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:14:47 user nova-compute[74429]:     </system>
Oct 23 20:14:47 user nova-compute[74429]:   </sysinfo>
Oct 23 20:14:47 user nova-compute[74429]:   <os>
Oct 23 20:14:47 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:14:47 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:14:47 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:14:47 user nova-compute[74429]:   </os>
Oct 23 20:14:47 user nova-compute[74429]:   <features>
Oct 23 20:14:47 user nova-compute[74429]:     <acpi/>
Oct 23 20:14:47 user nova-compute[74429]:     <apic/>
Oct 23 20:14:47 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:14:47 user nova-compute[74429]:   </features>
Oct 23 20:14:47 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:14:47 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:14:47 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:14:47 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:14:47 user nova-compute[74429]:   </clock>
Oct 23 20:14:47 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:14:47 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:14:47 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:14:47 user nova-compute[74429]:   </cpu>
Oct 23 20:14:47 user nova-compute[74429]:   <devices>
Oct 23 20:14:47 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:14:47 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:14:47 user nova-compute[74429]:       <source dev="/dev/sdd"/>
Oct 23 20:14:47 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:14:47 user nova-compute[74429]:       <serial>70ef0a13-d89b-44f4-822b-1cd41dadc596</serial>
Oct 23 20:14:47 user nova-compute[74429]:     </disk>
Oct 23 20:14:47 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:14:47 user nova-compute[74429]:       <mac address="fa:16:3e:7e:cb:70"/>
Oct 23 20:14:47 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:14:47 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:14:47 user nova-compute[74429]:       <target dev="tapfac1362d-5d"/>
Oct 23 20:14:47 user nova-compute[74429]:     </interface>
Oct 23 20:14:47 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:14:47 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235/console.log" append="off"/>
Oct 23 20:14:47 user nova-compute[74429]:     </serial>
Oct 23 20:14:47 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:14:47 user nova-compute[74429]:     <video>
Oct 23 20:14:47 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:14:47 user nova-compute[74429]:     </video>
Oct 23 20:14:47 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:14:47 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:14:47 user nova-compute[74429]:     </rng>
Oct 23 20:14:47 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:14:47 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:14:47 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:14:47 user nova-compute[74429]:     </memballoon>
Oct 23 20:14:47 user nova-compute[74429]:   </devices>
Oct 23 20:14:47 user nova-compute[74429]: </domain>
Oct 23 20:14:47 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-324355928',display_name='tempest-TestShelveInstance-server-324355928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-324355928',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1295653859',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d4a64891d474410aacce30e403d2f625',ramdisk_id='',reservation_id='r-yngx7jwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1011766138',owner_user_name='tempest-TestShelveInstance-1011766138-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:14:14Z,user_data=None,user_id='da9987f7f5024cb2b0094f1efd8fc942',uuid=5b24653c-f35e-4aec-aa2c-d6cfd7616235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converting VIF {"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG os_vif [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c1e495-3398-5c5c-a360-ddc2521217d2', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfac1362d-5d, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfac1362d-5d, col_values=(('qos', UUID('6a5948b1-c2f8-4d17-9541-7b7f29d57525')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfac1362d-5d, col_values=(('external_ids', {'iface-id': 'fac1362d-5d37-445e-9987-b454e179e242', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:cb:70', 'vm-uuid': '5b24653c-f35e-4aec-aa2c-d6cfd7616235'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:47 user nova-compute[74429]: INFO os_vif [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d')
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:14:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] No VIF found with MAC fa:16:3e:7e:cb:70, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:14:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:48 user nova-compute[74429]: INFO nova.compute.manager [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Detaching volume a8c82f54-e6bf-44b4-9cc7-8029dc461df4
Oct 23 20:14:48 user nova-compute[74429]: INFO nova.virt.block_device [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Attempting to driver detach volume a8c82f54-e6bf-44b4-9cc7-8029dc461df4 from mountpoint /dev/vdb
Oct 23 20:14:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Attempting to detach device vdb from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:14:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:14:48 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:14:48 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:14:48 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:14:48 user nova-compute[74429]:   <serial>a8c82f54-e6bf-44b4-9cc7-8029dc461df4</serial>
Oct 23 20:14:48 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 20:14:48 user nova-compute[74429]: </disk>
Oct 23 20:14:48 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:14:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully detached device vdb from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the persistent domain config.
Oct 23 20:14:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:14:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:14:48 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:14:48 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:14:48 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:14:48 user nova-compute[74429]:   <serial>a8c82f54-e6bf-44b4-9cc7-8029dc461df4</serial>
Oct 23 20:14:48 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 20:14:48 user nova-compute[74429]: </disk>
Oct 23 20:14:48 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0c04242-f65f-4dfb-8de1-8329e45f9f67 req-f6a2d340-9b3f-4c34-9577-f69384d8eb04 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0c04242-f65f-4dfb-8de1-8329e45f9f67 req-f6a2d340-9b3f-4c34-9577-f69384d8eb04 service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0c04242-f65f-4dfb-8de1-8329e45f9f67 req-f6a2d340-9b3f-4c34-9577-f69384d8eb04 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0c04242-f65f-4dfb-8de1-8329e45f9f67 req-f6a2d340-9b3f-4c34-9577-f69384d8eb04 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0c04242-f65f-4dfb-8de1-8329e45f9f67 req-f6a2d340-9b3f-4c34-9577-f69384d8eb04 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:49 user nova-compute[74429]: WARNING nova.compute.manager [req-a0c04242-f65f-4dfb-8de1-8329e45f9f67 req-f6a2d340-9b3f-4c34-9577-f69384d8eb04 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 20:14:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:14:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance spawned successfully.
Oct 23 20:14:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:14:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b5087c47-c040-4187-9e40-cc62a6bad3fd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.393s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:51 user nova-compute[74429]: WARNING nova.compute.manager [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:14:51 user nova-compute[74429]: WARNING nova.compute.manager [req-146bfdbe-a6b0-4bb5-93a8-21b3be1f245c req-f5240554-d64b-4589-a69c-b65ccfb43d31 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:14:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance spawned successfully.
Oct 23 20:14:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:14:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc8c9310-fd2b-47d6-9a79-fe68476243f3 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 38.306s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:14:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:14:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:06 user nova-compute[74429]: INFO nova.compute.manager [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Terminating instance
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-050c2b0c-c59e-4238-9724-b66b7f045b2e req-cb518cad-1c17-480a-a54a-780ce54f0b47 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-vif-unplugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-050c2b0c-c59e-4238-9724-b66b7f045b2e req-cb518cad-1c17-480a-a54a-780ce54f0b47 service nova] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-050c2b0c-c59e-4238-9724-b66b7f045b2e req-cb518cad-1c17-480a-a54a-780ce54f0b47 service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-050c2b0c-c59e-4238-9724-b66b7f045b2e req-cb518cad-1c17-480a-a54a-780ce54f0b47 service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-050c2b0c-c59e-4238-9724-b66b7f045b2e req-cb518cad-1c17-480a-a54a-780ce54f0b47 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] No waiting events found dispatching network-vif-unplugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-050c2b0c-c59e-4238-9724-b66b7f045b2e req-cb518cad-1c17-480a-a54a-780ce54f0b47 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-vif-unplugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:15:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Instance destroyed successfully.
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lazy-loading 'resources' on Instance uuid dc41e78e-050f-429e-b0b9-f4473a07c2c7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T19:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1483926802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1483926802',id=1,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T19:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='201753405b7c4553af3b39f82311a3d2',ramdisk_id='',reservation_id='r-pg10sb06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:01:16Z,user_data=None,user_id='734b0b0d04104bfeab582780b77764cf',uuid=dc41e78e-050f-429e-b0b9-f4473a07c2c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converting VIF {"id": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "address": "fa:16:3e:fc:53:06", "network": {"id": "2a1a85f8-fde1-4a3f-b92a-da46df39ff30", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-426129027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "201753405b7c4553af3b39f82311a3d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a41e75-0f", "ovs_interfaceid": "83a41e75-0f8b-4af5-9d69-518b6d12d356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG os_vif [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83a41e75-0f, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43154415-20d8-4587-b2a1-f6450e02539f) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:06 user nova-compute[74429]: INFO os_vif [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:06,bridge_name='br-int',has_traffic_filtering=True,id=83a41e75-0f8b-4af5-9d69-518b6d12d356,network=Network(2a1a85f8-fde1-4a3f-b92a-da46df39ff30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a41e75-0f')
Oct 23 20:15:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Deleting instance files /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7_del
Oct 23 20:15:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Deletion of /opt/stack/data/nova/instances/dc41e78e-050f-429e-b0b9-f4473a07c2c7_del complete
Oct 23 20:15:06 user nova-compute[74429]: INFO nova.compute.manager [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 20:15:06 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:15:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:15:07 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:07 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Took 0.37 seconds to deallocate network for instance.
Oct 23 20:15:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:07 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:15:07 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:15:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:07 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Deleted allocations for instance dc41e78e-050f-429e-b0b9-f4473a07c2c7
Oct 23 20:15:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-21956bdc-195f-4214-8a34-2135aa58ac12 tempest-ServerBootFromVolumeStableRescueTest-1279644555 tempest-ServerBootFromVolumeStableRescueTest-1279644555-project-member] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.706s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] Acquiring lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] Lock "dc41e78e-050f-429e-b0b9-f4473a07c2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] No waiting events found dispatching network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:08 user nova-compute[74429]: WARNING nova.compute.manager [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received unexpected event network-vif-plugged-83a41e75-0f8b-4af5-9d69-518b6d12d356 for instance with vm_state deleted and task_state None.
Oct 23 20:15:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-9867720d-744d-4fcd-a221-aa03b219af95 req-c54c0c55-1c91-4af6-82cc-1229081289d2 service nova] [instance: dc41e78e-050f-429e-b0b9-f4473a07c2c7] Received event network-vif-deleted-83a41e75-0f8b-4af5-9d69-518b6d12d356 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:09 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3315b73b-413e-40f2-89bf-e285b13d702a is timed out.
Oct 23 20:15:09 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully detached device vdb from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the live domain config.
Oct 23 20:15:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPzhZjEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:15:09 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f1ad43-522e-402b-b56c-711dd5a3c9d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:15:09 user nova-compute[74429]: No targets found.
Oct 23 20:15:09 user nova-compute[74429]: iSNS:
Oct 23 20:15:09 user nova-compute[74429]: No targets found.
Oct 23 20:15:09 user nova-compute[74429]: STATIC:
Oct 23 20:15:09 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596
Oct 23 20:15:09 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:15:09 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:15:09 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816
Oct 23 20:15:09 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:15:09 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:15:09 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4
Oct 23 20:15:09 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:15:09 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:15:09 user nova-compute[74429]: FIRMWARE:
Oct 23 20:15:09 user nova-compute[74429]: No targets found.
Oct 23 20:15:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:15:09 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:15:09 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f167bf-b5fe-45c6-99ad-ea62220a1da3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebad3d4-6249-4df0-aab1-bce5c5f989f5]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:15:09 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:15:09 user nova-compute[74429]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:15:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:15:09 user nova-compute[74429]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 (non-flash)
Oct 23 20:15:09 user nova-compute[74429]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:15:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5057e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0a324-b70b-4f93-82f9-69848e5f1264]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5291cf-c982-4092-bb1c-cd1428753221]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf09b5-d570-46f7-bdb8-c8afa68584f5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c1f586-6cf9-4ca4-a5e8-8c6d6f271527]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379654d-dbe8-42a6-a128-f440e6613d22]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446ba8e-1fc4-4ac1-b89a-26f3e16a2c6c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260]
Oct 23 20:15:09 user nova-compute[74429]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4, portal: 172.16.0.220,3260] successful.
Oct 23 20:15:09 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c82f54-e6bf-44b4-9cc7-8029dc461df4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd22ea-af35-48c2-ab1e-cd798d109d3c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] <== disconnect_volume: return (287ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:15:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:15:10 user nova-compute[74429]: DEBUG nova.objects.instance [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'flavor' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:15:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa53fc91-6c60-414f-9e03-ff324b692c77 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.842s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "interface-3315b73b-413e-40f2-89bf-e285b13d702a-31a6e343-e973-4c7b-b076-78072bac534f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "interface-3315b73b-413e-40f2-89bf-e285b13d702a-31a6e343-e973-4c7b-b076-78072bac534f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'flavor' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface> {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface> {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Attempting to detach device tap31a6e343-e9 from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] detach device xml: <interface type="ethernet">
Oct 23 20:15:11 user nova-compute[74429]:   <mac address="fa:16:3e:38:4e:a4"/>
Oct 23 20:15:11 user nova-compute[74429]:   <model type="virtio"/>
Oct 23 20:15:11 user nova-compute[74429]:   <mtu size="1442"/>
Oct 23 20:15:11 user nova-compute[74429]:   <target dev="tap31a6e343-e9"/>
Oct 23 20:15:11 user nova-compute[74429]: </interface>
Oct 23 20:15:11 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface> {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface>not found in domain: <domain type='kvm' id='36'>
Oct 23 20:15:11 user nova-compute[74429]:   <name>instance-0000001a</name>
Oct 23 20:15:11 user nova-compute[74429]:   <uuid>3315b73b-413e-40f2-89bf-e285b13d702a</uuid>
Oct 23 20:15:11 user nova-compute[74429]:   <metadata>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:15:11 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:15:11 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:15:11 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:14:09</nova:creationTime>
Oct 23 20:15:11 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:15:11 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:15:11 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:15:11 user nova-compute[74429]:   <nova:owner>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:15:11 user nova-compute[74429]:   </nova:owner>
Oct 23 20:15:11 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:15:11 user nova-compute[74429]:   <nova:ports>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:15:11 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:15:11 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:11 user nova-compute[74429]:     <nova:port uuid="31a6e343-e973-4c7b-b076-78072bac534f">
Oct 23 20:15:11 user nova-compute[74429]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Oct 23 20:15:11 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:11 user nova-compute[74429]:   </nova:ports>
Oct 23 20:15:11 user nova-compute[74429]: </nova:instance>
Oct 23 20:15:11 user nova-compute[74429]:   </metadata>
Oct 23 20:15:11 user nova-compute[74429]:   <memory unit='KiB'>524288</memory>
Oct 23 20:15:11 user nova-compute[74429]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 20:15:11 user nova-compute[74429]:   <vcpu placement='static'>1</vcpu>
Oct 23 20:15:11 user nova-compute[74429]:   <resource>
Oct 23 20:15:11 user nova-compute[74429]:     <partition>/machine</partition>
Oct 23 20:15:11 user nova-compute[74429]:   </resource>
Oct 23 20:15:11 user nova-compute[74429]:   <sysinfo type='smbios'>
Oct 23 20:15:11 user nova-compute[74429]:     <system>
Oct 23 20:15:11 user nova-compute[74429]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 20:15:11 user nova-compute[74429]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 20:15:11 user nova-compute[74429]:       <entry name='version'>0.0.0</entry>
Oct 23 20:15:11 user nova-compute[74429]:       <entry name='serial'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:11 user nova-compute[74429]:       <entry name='uuid'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:11 user nova-compute[74429]:       <entry name='family'>Virtual Machine</entry>
Oct 23 20:15:11 user nova-compute[74429]:     </system>
Oct 23 20:15:11 user nova-compute[74429]:   </sysinfo>
Oct 23 20:15:11 user nova-compute[74429]:   <os>
Oct 23 20:15:11 user nova-compute[74429]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 20:15:11 user nova-compute[74429]:     <boot dev='hd'/>
Oct 23 20:15:11 user nova-compute[74429]:     <smbios mode='sysinfo'/>
Oct 23 20:15:11 user nova-compute[74429]:   </os>
Oct 23 20:15:11 user nova-compute[74429]:   <features>
Oct 23 20:15:11 user nova-compute[74429]:     <acpi/>
Oct 23 20:15:11 user nova-compute[74429]:     <apic/>
Oct 23 20:15:11 user nova-compute[74429]:     <vmcoreinfo state='on'/>
Oct 23 20:15:11 user nova-compute[74429]:   </features>
Oct 23 20:15:11 user nova-compute[74429]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 20:15:11 user nova-compute[74429]:     <model fallback='forbid'>Nehalem</model>
Oct 23 20:15:11 user nova-compute[74429]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 20:15:11 user nova-compute[74429]:     <feature policy='require' name='vme'/>
Oct 23 20:15:11 user nova-compute[74429]:     <feature policy='require' name='x2apic'/>
Oct 23 20:15:11 user nova-compute[74429]:     <feature policy='require' name='hypervisor'/>
Oct 23 20:15:11 user nova-compute[74429]:   </cpu>
Oct 23 20:15:11 user nova-compute[74429]:   <clock offset='utc'>
Oct 23 20:15:11 user nova-compute[74429]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 20:15:11 user nova-compute[74429]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 20:15:11 user nova-compute[74429]:     <timer name='hpet' present='no'/>
Oct 23 20:15:11 user nova-compute[74429]:   </clock>
Oct 23 20:15:11 user nova-compute[74429]:   <on_poweroff>destroy</on_poweroff>
Oct 23 20:15:11 user nova-compute[74429]:   <on_reboot>restart</on_reboot>
Oct 23 20:15:11 user nova-compute[74429]:   <on_crash>destroy</on_crash>
Oct 23 20:15:11 user nova-compute[74429]:   <devices>
Oct 23 20:15:11 user nova-compute[74429]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 20:15:11 user nova-compute[74429]:     <disk type='file' device='disk'>
Oct 23 20:15:11 user nova-compute[74429]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 20:15:11 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk' index='2'/>
Oct 23 20:15:11 user nova-compute[74429]:       <backingStore type='file' index='3'>
Oct 23 20:15:11 user nova-compute[74429]:         <format type='raw'/>
Oct 23 20:15:11 user nova-compute[74429]:         <source file='/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d'/>
Oct 23 20:15:11 user nova-compute[74429]:         <backingStore/>
Oct 23 20:15:11 user nova-compute[74429]:       </backingStore>
Oct 23 20:15:11 user nova-compute[74429]:       <target dev='vda' bus='virtio'/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='virtio-disk0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </disk>
Oct 23 20:15:11 user nova-compute[74429]:     <disk type='file' device='cdrom'>
Oct 23 20:15:11 user nova-compute[74429]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 20:15:11 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config' index='1'/>
Oct 23 20:15:11 user nova-compute[74429]:       <backingStore/>
Oct 23 20:15:11 user nova-compute[74429]:       <target dev='hda' bus='ide'/>
Oct 23 20:15:11 user nova-compute[74429]:       <readonly/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='ide0-0-0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </disk>
Oct 23 20:15:11 user nova-compute[74429]:     <controller type='usb' index='0' model='none'>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='usb'/>
Oct 23 20:15:11 user nova-compute[74429]:     </controller>
Oct 23 20:15:11 user nova-compute[74429]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='pci.0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </controller>
Oct 23 20:15:11 user nova-compute[74429]:     <controller type='ide' index='0'>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='ide'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 20:15:11 user nova-compute[74429]:     </controller>
Oct 23 20:15:11 user nova-compute[74429]:     <interface type='ethernet'>
Oct 23 20:15:11 user nova-compute[74429]:       <mac address='fa:16:3e:72:6c:0a'/>
Oct 23 20:15:11 user nova-compute[74429]:       <target dev='tape4d9ea6a-c8'/>
Oct 23 20:15:11 user nova-compute[74429]:       <model type='virtio'/>
Oct 23 20:15:11 user nova-compute[74429]:       <mtu size='1442'/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='net0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </interface>
Oct 23 20:15:11 user nova-compute[74429]:     <interface type='ethernet'>
Oct 23 20:15:11 user nova-compute[74429]:       <mac address='fa:16:3e:38:4e:a4'/>
Oct 23 20:15:11 user nova-compute[74429]:       <target dev='tap31a6e343-e9'/>
Oct 23 20:15:11 user nova-compute[74429]:       <model type='virtio'/>
Oct 23 20:15:11 user nova-compute[74429]:       <mtu size='1442'/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='net1'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </interface>
Oct 23 20:15:11 user nova-compute[74429]:     <serial type='pty'>
Oct 23 20:15:11 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:11 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:11 user nova-compute[74429]:       <target type='isa-serial' port='0'>
Oct 23 20:15:11 user nova-compute[74429]:         <model name='isa-serial'/>
Oct 23 20:15:11 user nova-compute[74429]:       </target>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </serial>
Oct 23 20:15:11 user nova-compute[74429]:     <console type='pty' tty='/dev/pts/11'>
Oct 23 20:15:11 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:11 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:11 user nova-compute[74429]:       <target type='serial' port='0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </console>
Oct 23 20:15:11 user nova-compute[74429]:     <input type='mouse' bus='ps2'>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='input0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </input>
Oct 23 20:15:11 user nova-compute[74429]:     <input type='keyboard' bus='ps2'>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='input1'/>
Oct 23 20:15:11 user nova-compute[74429]:     </input>
Oct 23 20:15:11 user nova-compute[74429]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Oct 23 20:15:11 user nova-compute[74429]:       <listen type='address' address='0.0.0.0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </graphics>
Oct 23 20:15:11 user nova-compute[74429]:     <audio id='1' type='none'/>
Oct 23 20:15:11 user nova-compute[74429]:     <video>
Oct 23 20:15:11 user nova-compute[74429]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='video0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </video>
Oct 23 20:15:11 user nova-compute[74429]:     <memballoon model='virtio'>
Oct 23 20:15:11 user nova-compute[74429]:       <stats period='10'/>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='balloon0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </memballoon>
Oct 23 20:15:11 user nova-compute[74429]:     <rng model='virtio'>
Oct 23 20:15:11 user nova-compute[74429]:       <backend model='random'>/dev/urandom</backend>
Oct 23 20:15:11 user nova-compute[74429]:       <alias name='rng0'/>
Oct 23 20:15:11 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 20:15:11 user nova-compute[74429]:     </rng>
Oct 23 20:15:11 user nova-compute[74429]:   </devices>
Oct 23 20:15:11 user nova-compute[74429]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 20:15:11 user nova-compute[74429]:     <label>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</label>
Oct 23 20:15:11 user nova-compute[74429]:     <imagelabel>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</imagelabel>
Oct 23 20:15:11 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:11 user nova-compute[74429]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 20:15:11 user nova-compute[74429]:     <label>+64055:+108</label>
Oct 23 20:15:11 user nova-compute[74429]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 20:15:11 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:11 user nova-compute[74429]: </domain>
Oct 23 20:15:11 user nova-compute[74429]:  {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 20:15:11 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully detached device tap31a6e343-e9 from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the persistent domain config.
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] (1/8): Attempting to detach device tap31a6e343-e9 with device alias net1 from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] detach device xml: <interface type="ethernet">
Oct 23 20:15:11 user nova-compute[74429]:   <mac address="fa:16:3e:38:4e:a4"/>
Oct 23 20:15:11 user nova-compute[74429]:   <model type="virtio"/>
Oct 23 20:15:11 user nova-compute[74429]:   <mtu size="1442"/>
Oct 23 20:15:11 user nova-compute[74429]:   <target dev="tap31a6e343-e9"/>
Oct 23 20:15:11 user nova-compute[74429]: </interface>
Oct 23 20:15:11 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Start waiting for the detach event from libvirt for device tap31a6e343-e9 with device alias net1 for instance 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-f993ef7c-208f-4be0-9e22-6f92b978b1b0 req-8b987141-14bd-429d-9ff7-355bdc8656a4 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-unplugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f993ef7c-208f-4be0-9e22-6f92b978b1b0 req-8b987141-14bd-429d-9ff7-355bdc8656a4 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f993ef7c-208f-4be0-9e22-6f92b978b1b0 req-8b987141-14bd-429d-9ff7-355bdc8656a4 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f993ef7c-208f-4be0-9e22-6f92b978b1b0 req-8b987141-14bd-429d-9ff7-355bdc8656a4 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-f993ef7c-208f-4be0-9e22-6f92b978b1b0 req-8b987141-14bd-429d-9ff7-355bdc8656a4 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-unplugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:11 user nova-compute[74429]: WARNING nova.compute.manager [req-f993ef7c-208f-4be0-9e22-6f92b978b1b0 req-8b987141-14bd-429d-9ff7-355bdc8656a4 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-unplugged-31a6e343-e973-4c7b-b076-78072bac534f for instance with vm_state active and task_state None.
Oct 23 20:15:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-d52c6a50-8244-4c23-8874-3aff38c2e147 req-0e93478d-8427-40a9-af08-37e3d5495fc9 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d52c6a50-8244-4c23-8874-3aff38c2e147 req-0e93478d-8427-40a9-af08-37e3d5495fc9 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d52c6a50-8244-4c23-8874-3aff38c2e147 req-0e93478d-8427-40a9-af08-37e3d5495fc9 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d52c6a50-8244-4c23-8874-3aff38c2e147 req-0e93478d-8427-40a9-af08-37e3d5495fc9 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-d52c6a50-8244-4c23-8874-3aff38c2e147 req-0e93478d-8427-40a9-af08-37e3d5495fc9 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:13 user nova-compute[74429]: WARNING nova.compute.manager [req-d52c6a50-8244-4c23-8874-3aff38c2e147 req-0e93478d-8427-40a9-af08-37e3d5495fc9 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-plugged-31a6e343-e973-4c7b-b076-78072bac534f for instance with vm_state active and task_state None.
Oct 23 20:15:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:17 user nova-compute[74429]: INFO nova.compute.manager [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Unrescuing
Oct 23 20:15:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG nova.objects.instance [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'flavor' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:15:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-af81286e-eb82-46bc-8e75-f37107875861 req-6f9b5662-0835-416e-99ac-e1ef71e8c20d service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-af81286e-eb82-46bc-8e75-f37107875861 req-6f9b5662-0835-416e-99ac-e1ef71e8c20d service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-af81286e-eb82-46bc-8e75-f37107875861 req-6f9b5662-0835-416e-99ac-e1ef71e8c20d service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-af81286e-eb82-46bc-8e75-f37107875861 req-6f9b5662-0835-416e-99ac-e1ef71e8c20d service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-af81286e-eb82-46bc-8e75-f37107875861 req-6f9b5662-0835-416e-99ac-e1ef71e8c20d service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:18 user nova-compute[74429]: WARNING nova.compute.manager [req-af81286e-eb82-46bc-8e75-f37107875861 req-6f9b5662-0835-416e-99ac-e1ef71e8c20d service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:15:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance destroyed successfully.
Oct 23 20:15:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:20 user nova-compute[74429]: WARNING nova.compute.manager [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:15:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:20 user nova-compute[74429]: WARNING nova.compute.manager [req-f96be7e8-a2a7-43d2-9d33-a1dcdc1ef030 req-e93411ca-aab8-4920-bbc0-3792b103f508 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:15:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-18b5ff94-50fb-4698-ba48-e35aa93f63ba tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-389f474f-efa6-42f4-88fc-bb6eda2d4d54 req-3a86e75c-3075-4a04-983d-36fc13dd582e service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-389f474f-efa6-42f4-88fc-bb6eda2d4d54 req-3a86e75c-3075-4a04-983d-36fc13dd582e service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-389f474f-efa6-42f4-88fc-bb6eda2d4d54 req-3a86e75c-3075-4a04-983d-36fc13dd582e service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-389f474f-efa6-42f4-88fc-bb6eda2d4d54 req-3a86e75c-3075-4a04-983d-36fc13dd582e service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-389f474f-efa6-42f4-88fc-bb6eda2d4d54 req-3a86e75c-3075-4a04-983d-36fc13dd582e service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:15:22 user nova-compute[74429]: WARNING nova.compute.manager [req-389f474f-efa6-42f4-88fc-bb6eda2d4d54 req-3a86e75c-3075-4a04-983d-36fc13dd582e service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state active and task_state None.
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:15:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:15:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7861MB free_disk=25.39063262939453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 3315b73b-413e-40f2-89bf-e285b13d702a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5b24653c-f35e-4aec-aa2c-d6cfd7616235 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance de91660d-61a1-4e58-a75d-8fed5386b6de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:15:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:15:25 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:15:25 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:15:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:15:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:15:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:15:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:15:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:15:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 1e185be0-50d7-4243-89a7-6c68c8707947 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid bea3939d-9184-4ca5-aa4a-dba0a1be6af8 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "6c590343-5b24-4425-90be-423c44902c73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "6c590343-5b24-4425-90be-423c44902c73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:15:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:15:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Waiting for libvirt event about the detach of device tap31a6e343-e9 with device alias net1 from instance 3315b73b-413e-40f2-89bf-e285b13d702a is timed out.
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface> {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface>not found in domain: <domain type='kvm' id='36'>
Oct 23 20:15:31 user nova-compute[74429]:   <name>instance-0000001a</name>
Oct 23 20:15:31 user nova-compute[74429]:   <uuid>3315b73b-413e-40f2-89bf-e285b13d702a</uuid>
Oct 23 20:15:31 user nova-compute[74429]:   <metadata>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:15:31 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:14:09</nova:creationTime>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:15:31 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:15:31 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:owner>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:15:31 user nova-compute[74429]:   </nova:owner>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:ports>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:15:31 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:15:31 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:port uuid="31a6e343-e973-4c7b-b076-78072bac534f">
Oct 23 20:15:31 user nova-compute[74429]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Oct 23 20:15:31 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:31 user nova-compute[74429]:   </nova:ports>
Oct 23 20:15:31 user nova-compute[74429]: </nova:instance>
Oct 23 20:15:31 user nova-compute[74429]:   </metadata>
Oct 23 20:15:31 user nova-compute[74429]:   <memory unit='KiB'>524288</memory>
Oct 23 20:15:31 user nova-compute[74429]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 20:15:31 user nova-compute[74429]:   <vcpu placement='static'>1</vcpu>
Oct 23 20:15:31 user nova-compute[74429]:   <resource>
Oct 23 20:15:31 user nova-compute[74429]:     <partition>/machine</partition>
Oct 23 20:15:31 user nova-compute[74429]:   </resource>
Oct 23 20:15:31 user nova-compute[74429]:   <sysinfo type='smbios'>
Oct 23 20:15:31 user nova-compute[74429]:     <system>
Oct 23 20:15:31 user nova-compute[74429]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 20:15:31 user nova-compute[74429]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 20:15:31 user nova-compute[74429]:       <entry name='version'>0.0.0</entry>
Oct 23 20:15:31 user nova-compute[74429]:       <entry name='serial'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:31 user nova-compute[74429]:       <entry name='uuid'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:31 user nova-compute[74429]:       <entry name='family'>Virtual Machine</entry>
Oct 23 20:15:31 user nova-compute[74429]:     </system>
Oct 23 20:15:31 user nova-compute[74429]:   </sysinfo>
Oct 23 20:15:31 user nova-compute[74429]:   <os>
Oct 23 20:15:31 user nova-compute[74429]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 20:15:31 user nova-compute[74429]:     <boot dev='hd'/>
Oct 23 20:15:31 user nova-compute[74429]:     <smbios mode='sysinfo'/>
Oct 23 20:15:31 user nova-compute[74429]:   </os>
Oct 23 20:15:31 user nova-compute[74429]:   <features>
Oct 23 20:15:31 user nova-compute[74429]:     <acpi/>
Oct 23 20:15:31 user nova-compute[74429]:     <apic/>
Oct 23 20:15:31 user nova-compute[74429]:     <vmcoreinfo state='on'/>
Oct 23 20:15:31 user nova-compute[74429]:   </features>
Oct 23 20:15:31 user nova-compute[74429]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 20:15:31 user nova-compute[74429]:     <model fallback='forbid'>Nehalem</model>
Oct 23 20:15:31 user nova-compute[74429]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 20:15:31 user nova-compute[74429]:     <feature policy='require' name='vme'/>
Oct 23 20:15:31 user nova-compute[74429]:     <feature policy='require' name='x2apic'/>
Oct 23 20:15:31 user nova-compute[74429]:     <feature policy='require' name='hypervisor'/>
Oct 23 20:15:31 user nova-compute[74429]:   </cpu>
Oct 23 20:15:31 user nova-compute[74429]:   <clock offset='utc'>
Oct 23 20:15:31 user nova-compute[74429]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 20:15:31 user nova-compute[74429]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 20:15:31 user nova-compute[74429]:     <timer name='hpet' present='no'/>
Oct 23 20:15:31 user nova-compute[74429]:   </clock>
Oct 23 20:15:31 user nova-compute[74429]:   <on_poweroff>destroy</on_poweroff>
Oct 23 20:15:31 user nova-compute[74429]:   <on_reboot>restart</on_reboot>
Oct 23 20:15:31 user nova-compute[74429]:   <on_crash>destroy</on_crash>
Oct 23 20:15:31 user nova-compute[74429]:   <devices>
Oct 23 20:15:31 user nova-compute[74429]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 20:15:31 user nova-compute[74429]:     <disk type='file' device='disk'>
Oct 23 20:15:31 user nova-compute[74429]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 20:15:31 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk' index='2'/>
Oct 23 20:15:31 user nova-compute[74429]:       <backingStore type='file' index='3'>
Oct 23 20:15:31 user nova-compute[74429]:         <format type='raw'/>
Oct 23 20:15:31 user nova-compute[74429]:         <source file='/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d'/>
Oct 23 20:15:31 user nova-compute[74429]:         <backingStore/>
Oct 23 20:15:31 user nova-compute[74429]:       </backingStore>
Oct 23 20:15:31 user nova-compute[74429]:       <target dev='vda' bus='virtio'/>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='virtio-disk0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </disk>
Oct 23 20:15:31 user nova-compute[74429]:     <disk type='file' device='cdrom'>
Oct 23 20:15:31 user nova-compute[74429]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 20:15:31 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config' index='1'/>
Oct 23 20:15:31 user nova-compute[74429]:       <backingStore/>
Oct 23 20:15:31 user nova-compute[74429]:       <target dev='hda' bus='ide'/>
Oct 23 20:15:31 user nova-compute[74429]:       <readonly/>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='ide0-0-0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </disk>
Oct 23 20:15:31 user nova-compute[74429]:     <controller type='usb' index='0' model='none'>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='usb'/>
Oct 23 20:15:31 user nova-compute[74429]:     </controller>
Oct 23 20:15:31 user nova-compute[74429]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='pci.0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </controller>
Oct 23 20:15:31 user nova-compute[74429]:     <controller type='ide' index='0'>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='ide'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 20:15:31 user nova-compute[74429]:     </controller>
Oct 23 20:15:31 user nova-compute[74429]:     <interface type='ethernet'>
Oct 23 20:15:31 user nova-compute[74429]:       <mac address='fa:16:3e:72:6c:0a'/>
Oct 23 20:15:31 user nova-compute[74429]:       <target dev='tape4d9ea6a-c8'/>
Oct 23 20:15:31 user nova-compute[74429]:       <model type='virtio'/>
Oct 23 20:15:31 user nova-compute[74429]:       <mtu size='1442'/>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='net0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </interface>
Oct 23 20:15:31 user nova-compute[74429]:     <serial type='pty'>
Oct 23 20:15:31 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:31 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:31 user nova-compute[74429]:       <target type='isa-serial' port='0'>
Oct 23 20:15:31 user nova-compute[74429]:         <model name='isa-serial'/>
Oct 23 20:15:31 user nova-compute[74429]:       </target>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </serial>
Oct 23 20:15:31 user nova-compute[74429]:     <console type='pty' tty='/dev/pts/11'>
Oct 23 20:15:31 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:31 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:31 user nova-compute[74429]:       <target type='serial' port='0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </console>
Oct 23 20:15:31 user nova-compute[74429]:     <input type='mouse' bus='ps2'>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='input0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </input>
Oct 23 20:15:31 user nova-compute[74429]:     <input type='keyboard' bus='ps2'>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='input1'/>
Oct 23 20:15:31 user nova-compute[74429]:     </input>
Oct 23 20:15:31 user nova-compute[74429]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Oct 23 20:15:31 user nova-compute[74429]:       <listen type='address' address='0.0.0.0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </graphics>
Oct 23 20:15:31 user nova-compute[74429]:     <audio id='1' type='none'/>
Oct 23 20:15:31 user nova-compute[74429]:     <video>
Oct 23 20:15:31 user nova-compute[74429]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='video0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </video>
Oct 23 20:15:31 user nova-compute[74429]:     <memballoon model='virtio'>
Oct 23 20:15:31 user nova-compute[74429]:       <stats period='10'/>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='balloon0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </memballoon>
Oct 23 20:15:31 user nova-compute[74429]:     <rng model='virtio'>
Oct 23 20:15:31 user nova-compute[74429]:       <backend model='random'>/dev/urandom</backend>
Oct 23 20:15:31 user nova-compute[74429]:       <alias name='rng0'/>
Oct 23 20:15:31 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 20:15:31 user nova-compute[74429]:     </rng>
Oct 23 20:15:31 user nova-compute[74429]:   </devices>
Oct 23 20:15:31 user nova-compute[74429]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 20:15:31 user nova-compute[74429]:     <label>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</label>
Oct 23 20:15:31 user nova-compute[74429]:     <imagelabel>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</imagelabel>
Oct 23 20:15:31 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:31 user nova-compute[74429]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 20:15:31 user nova-compute[74429]:     <label>+64055:+108</label>
Oct 23 20:15:31 user nova-compute[74429]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 20:15:31 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:31 user nova-compute[74429]: </domain>
Oct 23 20:15:31 user nova-compute[74429]:  {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 20:15:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully detached device tap31a6e343-e9 from instance 3315b73b-413e-40f2-89bf-e285b13d702a from the live domain config.
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG os_vif [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31a6e343-e9, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db0e5c05-5927-4d7c-80e6-9cda4ef6f8c7) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:31 user nova-compute[74429]: INFO os_vif [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9')
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:15:31 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:15:31</nova:creationTime>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:15:31 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:15:31 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:owner>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:15:31 user nova-compute[74429]:   </nova:owner>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:15:31 user nova-compute[74429]:   <nova:ports>
Oct 23 20:15:31 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:15:31 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:15:31 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:31 user nova-compute[74429]:   </nova:ports>
Oct 23 20:15:31 user nova-compute[74429]: </nova:instance>
Oct 23 20:15:31 user nova-compute[74429]:  {{(pid=74429) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-deleted-31a6e343-e973-4c7b-b076-78072bac534f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:31 user nova-compute[74429]: INFO nova.compute.manager [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Neutron deleted interface 31a6e343-e973-4c7b-b076-78072bac534f; detaching it from the instance and deleting it from the info cache
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.network.neutron [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquired lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:15:31 user nova-compute[74429]: DEBUG nova.objects.instance [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Lazy-loading 'system_metadata' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.objects.instance [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Lazy-loading 'flavor' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.objects.base [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Object Instance<3315b73b-413e-40f2-89bf-e285b13d702a> lazy-loaded attributes: system_metadata,flavor {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.network.os_vif_util [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Converting VIF {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.network.os_vif_util [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface> {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface>not found in domain: <domain type='kvm' id='36'>
Oct 23 20:15:32 user nova-compute[74429]:   <name>instance-0000001a</name>
Oct 23 20:15:32 user nova-compute[74429]:   <uuid>3315b73b-413e-40f2-89bf-e285b13d702a</uuid>
Oct 23 20:15:32 user nova-compute[74429]:   <metadata>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:15:32 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:15:31</nova:creationTime>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:15:32 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:owner>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:owner>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:ports>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:15:32 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:15:32 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:ports>
Oct 23 20:15:32 user nova-compute[74429]: </nova:instance>
Oct 23 20:15:32 user nova-compute[74429]:   </metadata>
Oct 23 20:15:32 user nova-compute[74429]:   <memory unit='KiB'>524288</memory>
Oct 23 20:15:32 user nova-compute[74429]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 20:15:32 user nova-compute[74429]:   <vcpu placement='static'>1</vcpu>
Oct 23 20:15:32 user nova-compute[74429]:   <resource>
Oct 23 20:15:32 user nova-compute[74429]:     <partition>/machine</partition>
Oct 23 20:15:32 user nova-compute[74429]:   </resource>
Oct 23 20:15:32 user nova-compute[74429]:   <sysinfo type='smbios'>
Oct 23 20:15:32 user nova-compute[74429]:     <system>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='version'>0.0.0</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='serial'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='uuid'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='family'>Virtual Machine</entry>
Oct 23 20:15:32 user nova-compute[74429]:     </system>
Oct 23 20:15:32 user nova-compute[74429]:   </sysinfo>
Oct 23 20:15:32 user nova-compute[74429]:   <os>
Oct 23 20:15:32 user nova-compute[74429]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 20:15:32 user nova-compute[74429]:     <boot dev='hd'/>
Oct 23 20:15:32 user nova-compute[74429]:     <smbios mode='sysinfo'/>
Oct 23 20:15:32 user nova-compute[74429]:   </os>
Oct 23 20:15:32 user nova-compute[74429]:   <features>
Oct 23 20:15:32 user nova-compute[74429]:     <acpi/>
Oct 23 20:15:32 user nova-compute[74429]:     <apic/>
Oct 23 20:15:32 user nova-compute[74429]:     <vmcoreinfo state='on'/>
Oct 23 20:15:32 user nova-compute[74429]:   </features>
Oct 23 20:15:32 user nova-compute[74429]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 20:15:32 user nova-compute[74429]:     <model fallback='forbid'>Nehalem</model>
Oct 23 20:15:32 user nova-compute[74429]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 20:15:32 user nova-compute[74429]:     <feature policy='require' name='vme'/>
Oct 23 20:15:32 user nova-compute[74429]:     <feature policy='require' name='x2apic'/>
Oct 23 20:15:32 user nova-compute[74429]:     <feature policy='require' name='hypervisor'/>
Oct 23 20:15:32 user nova-compute[74429]:   </cpu>
Oct 23 20:15:32 user nova-compute[74429]:   <clock offset='utc'>
Oct 23 20:15:32 user nova-compute[74429]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 20:15:32 user nova-compute[74429]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 20:15:32 user nova-compute[74429]:     <timer name='hpet' present='no'/>
Oct 23 20:15:32 user nova-compute[74429]:   </clock>
Oct 23 20:15:32 user nova-compute[74429]:   <on_poweroff>destroy</on_poweroff>
Oct 23 20:15:32 user nova-compute[74429]:   <on_reboot>restart</on_reboot>
Oct 23 20:15:32 user nova-compute[74429]:   <on_crash>destroy</on_crash>
Oct 23 20:15:32 user nova-compute[74429]:   <devices>
Oct 23 20:15:32 user nova-compute[74429]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 20:15:32 user nova-compute[74429]:     <disk type='file' device='disk'>
Oct 23 20:15:32 user nova-compute[74429]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 20:15:32 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk' index='2'/>
Oct 23 20:15:32 user nova-compute[74429]:       <backingStore type='file' index='3'>
Oct 23 20:15:32 user nova-compute[74429]:         <format type='raw'/>
Oct 23 20:15:32 user nova-compute[74429]:         <source file='/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d'/>
Oct 23 20:15:32 user nova-compute[74429]:         <backingStore/>
Oct 23 20:15:32 user nova-compute[74429]:       </backingStore>
Oct 23 20:15:32 user nova-compute[74429]:       <target dev='vda' bus='virtio'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='virtio-disk0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </disk>
Oct 23 20:15:32 user nova-compute[74429]:     <disk type='file' device='cdrom'>
Oct 23 20:15:32 user nova-compute[74429]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 20:15:32 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config' index='1'/>
Oct 23 20:15:32 user nova-compute[74429]:       <backingStore/>
Oct 23 20:15:32 user nova-compute[74429]:       <target dev='hda' bus='ide'/>
Oct 23 20:15:32 user nova-compute[74429]:       <readonly/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='ide0-0-0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </disk>
Oct 23 20:15:32 user nova-compute[74429]:     <controller type='usb' index='0' model='none'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='usb'/>
Oct 23 20:15:32 user nova-compute[74429]:     </controller>
Oct 23 20:15:32 user nova-compute[74429]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='pci.0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </controller>
Oct 23 20:15:32 user nova-compute[74429]:     <controller type='ide' index='0'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='ide'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 20:15:32 user nova-compute[74429]:     </controller>
Oct 23 20:15:32 user nova-compute[74429]:     <interface type='ethernet'>
Oct 23 20:15:32 user nova-compute[74429]:       <mac address='fa:16:3e:72:6c:0a'/>
Oct 23 20:15:32 user nova-compute[74429]:       <target dev='tape4d9ea6a-c8'/>
Oct 23 20:15:32 user nova-compute[74429]:       <model type='virtio'/>
Oct 23 20:15:32 user nova-compute[74429]:       <mtu size='1442'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='net0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </interface>
Oct 23 20:15:32 user nova-compute[74429]:     <serial type='pty'>
Oct 23 20:15:32 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:32 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:32 user nova-compute[74429]:       <target type='isa-serial' port='0'>
Oct 23 20:15:32 user nova-compute[74429]:         <model name='isa-serial'/>
Oct 23 20:15:32 user nova-compute[74429]:       </target>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </serial>
Oct 23 20:15:32 user nova-compute[74429]:     <console type='pty' tty='/dev/pts/11'>
Oct 23 20:15:32 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:32 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:32 user nova-compute[74429]:       <target type='serial' port='0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </console>
Oct 23 20:15:32 user nova-compute[74429]:     <input type='mouse' bus='ps2'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='input0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </input>
Oct 23 20:15:32 user nova-compute[74429]:     <input type='keyboard' bus='ps2'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='input1'/>
Oct 23 20:15:32 user nova-compute[74429]:     </input>
Oct 23 20:15:32 user nova-compute[74429]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Oct 23 20:15:32 user nova-compute[74429]:       <listen type='address' address='0.0.0.0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </graphics>
Oct 23 20:15:32 user nova-compute[74429]:     <audio id='1' type='none'/>
Oct 23 20:15:32 user nova-compute[74429]:     <video>
Oct 23 20:15:32 user nova-compute[74429]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='video0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </video>
Oct 23 20:15:32 user nova-compute[74429]:     <memballoon model='virtio'>
Oct 23 20:15:32 user nova-compute[74429]:       <stats period='10'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='balloon0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </memballoon>
Oct 23 20:15:32 user nova-compute[74429]:     <rng model='virtio'>
Oct 23 20:15:32 user nova-compute[74429]:       <backend model='random'>/dev/urandom</backend>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='rng0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </rng>
Oct 23 20:15:32 user nova-compute[74429]:   </devices>
Oct 23 20:15:32 user nova-compute[74429]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 20:15:32 user nova-compute[74429]:     <label>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</label>
Oct 23 20:15:32 user nova-compute[74429]:     <imagelabel>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</imagelabel>
Oct 23 20:15:32 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:32 user nova-compute[74429]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 20:15:32 user nova-compute[74429]:     <label>+64055:+108</label>
Oct 23 20:15:32 user nova-compute[74429]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 20:15:32 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:32 user nova-compute[74429]: </domain>
Oct 23 20:15:32 user nova-compute[74429]:  {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface> {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:4e:a4"/><model type="virtio"/><mtu size="1442"/><target dev="tap31a6e343-e9"/></interface>not found in domain: <domain type='kvm' id='36'>
Oct 23 20:15:32 user nova-compute[74429]:   <name>instance-0000001a</name>
Oct 23 20:15:32 user nova-compute[74429]:   <uuid>3315b73b-413e-40f2-89bf-e285b13d702a</uuid>
Oct 23 20:15:32 user nova-compute[74429]:   <metadata>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:15:32 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:15:31</nova:creationTime>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:15:32 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:owner>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:owner>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:ports>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:15:32 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:15:32 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:ports>
Oct 23 20:15:32 user nova-compute[74429]: </nova:instance>
Oct 23 20:15:32 user nova-compute[74429]:   </metadata>
Oct 23 20:15:32 user nova-compute[74429]:   <memory unit='KiB'>524288</memory>
Oct 23 20:15:32 user nova-compute[74429]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 20:15:32 user nova-compute[74429]:   <vcpu placement='static'>1</vcpu>
Oct 23 20:15:32 user nova-compute[74429]:   <resource>
Oct 23 20:15:32 user nova-compute[74429]:     <partition>/machine</partition>
Oct 23 20:15:32 user nova-compute[74429]:   </resource>
Oct 23 20:15:32 user nova-compute[74429]:   <sysinfo type='smbios'>
Oct 23 20:15:32 user nova-compute[74429]:     <system>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='version'>0.0.0</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='serial'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='uuid'>3315b73b-413e-40f2-89bf-e285b13d702a</entry>
Oct 23 20:15:32 user nova-compute[74429]:       <entry name='family'>Virtual Machine</entry>
Oct 23 20:15:32 user nova-compute[74429]:     </system>
Oct 23 20:15:32 user nova-compute[74429]:   </sysinfo>
Oct 23 20:15:32 user nova-compute[74429]:   <os>
Oct 23 20:15:32 user nova-compute[74429]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 20:15:32 user nova-compute[74429]:     <boot dev='hd'/>
Oct 23 20:15:32 user nova-compute[74429]:     <smbios mode='sysinfo'/>
Oct 23 20:15:32 user nova-compute[74429]:   </os>
Oct 23 20:15:32 user nova-compute[74429]:   <features>
Oct 23 20:15:32 user nova-compute[74429]:     <acpi/>
Oct 23 20:15:32 user nova-compute[74429]:     <apic/>
Oct 23 20:15:32 user nova-compute[74429]:     <vmcoreinfo state='on'/>
Oct 23 20:15:32 user nova-compute[74429]:   </features>
Oct 23 20:15:32 user nova-compute[74429]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 20:15:32 user nova-compute[74429]:     <model fallback='forbid'>Nehalem</model>
Oct 23 20:15:32 user nova-compute[74429]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 20:15:32 user nova-compute[74429]:     <feature policy='require' name='vme'/>
Oct 23 20:15:32 user nova-compute[74429]:     <feature policy='require' name='x2apic'/>
Oct 23 20:15:32 user nova-compute[74429]:     <feature policy='require' name='hypervisor'/>
Oct 23 20:15:32 user nova-compute[74429]:   </cpu>
Oct 23 20:15:32 user nova-compute[74429]:   <clock offset='utc'>
Oct 23 20:15:32 user nova-compute[74429]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 20:15:32 user nova-compute[74429]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 20:15:32 user nova-compute[74429]:     <timer name='hpet' present='no'/>
Oct 23 20:15:32 user nova-compute[74429]:   </clock>
Oct 23 20:15:32 user nova-compute[74429]:   <on_poweroff>destroy</on_poweroff>
Oct 23 20:15:32 user nova-compute[74429]:   <on_reboot>restart</on_reboot>
Oct 23 20:15:32 user nova-compute[74429]:   <on_crash>destroy</on_crash>
Oct 23 20:15:32 user nova-compute[74429]:   <devices>
Oct 23 20:15:32 user nova-compute[74429]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 20:15:32 user nova-compute[74429]:     <disk type='file' device='disk'>
Oct 23 20:15:32 user nova-compute[74429]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 20:15:32 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk' index='2'/>
Oct 23 20:15:32 user nova-compute[74429]:       <backingStore type='file' index='3'>
Oct 23 20:15:32 user nova-compute[74429]:         <format type='raw'/>
Oct 23 20:15:32 user nova-compute[74429]:         <source file='/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d'/>
Oct 23 20:15:32 user nova-compute[74429]:         <backingStore/>
Oct 23 20:15:32 user nova-compute[74429]:       </backingStore>
Oct 23 20:15:32 user nova-compute[74429]:       <target dev='vda' bus='virtio'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='virtio-disk0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </disk>
Oct 23 20:15:32 user nova-compute[74429]:     <disk type='file' device='cdrom'>
Oct 23 20:15:32 user nova-compute[74429]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 20:15:32 user nova-compute[74429]:       <source file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/disk.config' index='1'/>
Oct 23 20:15:32 user nova-compute[74429]:       <backingStore/>
Oct 23 20:15:32 user nova-compute[74429]:       <target dev='hda' bus='ide'/>
Oct 23 20:15:32 user nova-compute[74429]:       <readonly/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='ide0-0-0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </disk>
Oct 23 20:15:32 user nova-compute[74429]:     <controller type='usb' index='0' model='none'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='usb'/>
Oct 23 20:15:32 user nova-compute[74429]:     </controller>
Oct 23 20:15:32 user nova-compute[74429]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='pci.0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </controller>
Oct 23 20:15:32 user nova-compute[74429]:     <controller type='ide' index='0'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='ide'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 20:15:32 user nova-compute[74429]:     </controller>
Oct 23 20:15:32 user nova-compute[74429]:     <interface type='ethernet'>
Oct 23 20:15:32 user nova-compute[74429]:       <mac address='fa:16:3e:72:6c:0a'/>
Oct 23 20:15:32 user nova-compute[74429]:       <target dev='tape4d9ea6a-c8'/>
Oct 23 20:15:32 user nova-compute[74429]:       <model type='virtio'/>
Oct 23 20:15:32 user nova-compute[74429]:       <mtu size='1442'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='net0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </interface>
Oct 23 20:15:32 user nova-compute[74429]:     <serial type='pty'>
Oct 23 20:15:32 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:32 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:32 user nova-compute[74429]:       <target type='isa-serial' port='0'>
Oct 23 20:15:32 user nova-compute[74429]:         <model name='isa-serial'/>
Oct 23 20:15:32 user nova-compute[74429]:       </target>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </serial>
Oct 23 20:15:32 user nova-compute[74429]:     <console type='pty' tty='/dev/pts/11'>
Oct 23 20:15:32 user nova-compute[74429]:       <source path='/dev/pts/11'/>
Oct 23 20:15:32 user nova-compute[74429]:       <log file='/opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a/console.log' append='off'/>
Oct 23 20:15:32 user nova-compute[74429]:       <target type='serial' port='0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='serial0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </console>
Oct 23 20:15:32 user nova-compute[74429]:     <input type='mouse' bus='ps2'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='input0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </input>
Oct 23 20:15:32 user nova-compute[74429]:     <input type='keyboard' bus='ps2'>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='input1'/>
Oct 23 20:15:32 user nova-compute[74429]:     </input>
Oct 23 20:15:32 user nova-compute[74429]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Oct 23 20:15:32 user nova-compute[74429]:       <listen type='address' address='0.0.0.0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </graphics>
Oct 23 20:15:32 user nova-compute[74429]:     <audio id='1' type='none'/>
Oct 23 20:15:32 user nova-compute[74429]:     <video>
Oct 23 20:15:32 user nova-compute[74429]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='video0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </video>
Oct 23 20:15:32 user nova-compute[74429]:     <memballoon model='virtio'>
Oct 23 20:15:32 user nova-compute[74429]:       <stats period='10'/>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='balloon0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </memballoon>
Oct 23 20:15:32 user nova-compute[74429]:     <rng model='virtio'>
Oct 23 20:15:32 user nova-compute[74429]:       <backend model='random'>/dev/urandom</backend>
Oct 23 20:15:32 user nova-compute[74429]:       <alias name='rng0'/>
Oct 23 20:15:32 user nova-compute[74429]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 20:15:32 user nova-compute[74429]:     </rng>
Oct 23 20:15:32 user nova-compute[74429]:   </devices>
Oct 23 20:15:32 user nova-compute[74429]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 20:15:32 user nova-compute[74429]:     <label>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</label>
Oct 23 20:15:32 user nova-compute[74429]:     <imagelabel>libvirt-3315b73b-413e-40f2-89bf-e285b13d702a</imagelabel>
Oct 23 20:15:32 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:32 user nova-compute[74429]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 20:15:32 user nova-compute[74429]:     <label>+64055:+108</label>
Oct 23 20:15:32 user nova-compute[74429]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 20:15:32 user nova-compute[74429]:   </seclabel>
Oct 23 20:15:32 user nova-compute[74429]: </domain>
Oct 23 20:15:32 user nova-compute[74429]:  {{(pid=74429) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 20:15:32 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Detaching interface fa:16:3e:38:4e:a4 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap31a6e343-e9' not found.
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.network.os_vif_util [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Converting VIF {"id": "31a6e343-e973-4c7b-b076-78072bac534f", "address": "fa:16:3e:38:4e:a4", "network": {"id": "b718665e-b818-45a9-afbe-64d183d1a05d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-728044769", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31a6e343-e9", "ovs_interfaceid": "31a6e343-e973-4c7b-b076-78072bac534f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.network.os_vif_util [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG os_vif [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31a6e343-e9, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:15:32 user nova-compute[74429]: INFO os_vif [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4e:a4,bridge_name='br-int',has_traffic_filtering=True,id=31a6e343-e973-4c7b-b076-78072bac534f,network=Network(b718665e-b818-45a9-afbe-64d183d1a05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31a6e343-e9')
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [req-dd6a324d-2f1c-4bcc-8ac6-62759cd022b8 req-fa10e021-369b-4f54-bf8a-924d57c4c388 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:15:32 user nova-compute[74429]:   <nova:package version="0.0.0"/>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:name>tempest-device-tagging-server-1445959414</nova:name>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:creationTime>2023-10-23 20:15:32</nova:creationTime>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:flavor name="m1.tiny">
Oct 23 20:15:32 user nova-compute[74429]:     <nova:memory>512</nova:memory>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:disk>1</nova:disk>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:swap>0</nova:swap>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:vcpus>1</nova:vcpus>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:flavor>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:owner>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:user uuid="ec7120776c404379ad8793a5b357d94f">tempest-TaggedAttachmentsTest-1650713372-project-member</nova:user>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:project uuid="18e85b6b40e54b5e81ee9dabef1e6b1f">tempest-TaggedAttachmentsTest-1650713372</nova:project>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:owner>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:15:32 user nova-compute[74429]:   <nova:ports>
Oct 23 20:15:32 user nova-compute[74429]:     <nova:port uuid="e4d9ea6a-c873-44ba-93d3-21a5da11c826">
Oct 23 20:15:32 user nova-compute[74429]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:15:32 user nova-compute[74429]:     </nova:port>
Oct 23 20:15:32 user nova-compute[74429]:   </nova:ports>
Oct 23 20:15:32 user nova-compute[74429]: </nova:instance>
Oct 23 20:15:32 user nova-compute[74429]:  {{(pid=74429) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [{"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Releasing lock "refresh_cache-3315b73b-413e-40f2-89bf-e285b13d702a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e00301cd-bfca-46e4-8d92-0ed2af330b86 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "interface-3315b73b-413e-40f2-89bf-e285b13d702a-31a6e343-e973-4c7b-b076-78072bac534f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.402s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:15:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:15:43 user nova-compute[74429]: INFO nova.compute.claims [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Claim successful on node user
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:15:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.policy [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80ac3c2700c2447993ba5a8e14db0aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8768b24d954f5cbb03c242e6a3a1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:15:43 user nova-compute[74429]: INFO nova.virt.block_device [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Booting with volume 711bc196-6062-46c7-a013-43a3f91a8ab7 at /dev/vda
Oct 23 20:15:43 user nova-compute[74429]: DEBUG os_brick.utils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6076aa7b-d90b-4482-b783-1061d5ed6a6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33103b-e430-486c-aec3-f3a2e3c2b99b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed4abe-5a14-48d2-bb6a-574d46f6be8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c4d23-ea2c-4831-9a0e-a985d5aef106]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:15:43 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:15:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d5261-c158-4f14-b1e1-6e9d6f6b71e9]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG os_brick.utils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:15:43 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating existing volume attachment record: e1571c7e-d890-41a3-8631-f1fb18038357 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Successfully created port: d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Successfully updated port: d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-changed-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Refreshing instance network info cache due to event network-changed-d0a97aae-567b-4f56-9860-6536c03f46c5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:15:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance network_info: |[{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Refreshing network info cache for port d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updated VIF entry in instance network info cache for port d0a97aae-567b-4f56-9860-6536c03f46c5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:15:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1e737095-434e-4694-863c-150831f38670 req-8b549773-4b70-4fee-81ff-6fbc37f3bf28 service nova] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:15:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:15:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:01 user nova-compute[74429]: INFO nova.compute.manager [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Terminating instance
Oct 23 20:16:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-7ed1046d-c6a4-469b-a397-a86edfde8ded req-624c5a41-6146-43f6-9a44-f41e18d23ee3 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-unplugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7ed1046d-c6a4-469b-a397-a86edfde8ded req-624c5a41-6146-43f6-9a44-f41e18d23ee3 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7ed1046d-c6a4-469b-a397-a86edfde8ded req-624c5a41-6146-43f6-9a44-f41e18d23ee3 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7ed1046d-c6a4-469b-a397-a86edfde8ded req-624c5a41-6146-43f6-9a44-f41e18d23ee3 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-7ed1046d-c6a4-469b-a397-a86edfde8ded req-624c5a41-6146-43f6-9a44-f41e18d23ee3 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-unplugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-7ed1046d-c6a4-469b-a397-a86edfde8ded req-624c5a41-6146-43f6-9a44-f41e18d23ee3 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-unplugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:16:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Instance destroyed successfully.
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lazy-loading 'resources' on Instance uuid 3315b73b-413e-40f2-89bf-e285b13d702a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T20:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1445959414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1445959414',id=26,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgOspNvIV9CIzB3ogM4hQOFfTbW2zKyPOPmsusxpZkQm4v+GuqmUnbB92ImQgQcV/7Em/G+wNsmAntdfHXKrxUvdnttQgMoEJvFxUMlg4fWfwr6NUItkcpZhvRZRUB7QQ==',key_name='tempest-keypair-1989799575',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e85b6b40e54b5e81ee9dabef1e6b1f',ramdisk_id='',reservation_id='r-qtq5phju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1650713372',owner_user_name='tempest-TaggedAttachmentsTest-1650713372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec7120776c404379ad8793a5b357d94f',uuid=3315b73b-413e-40f2-89bf-e285b13d702a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converting VIF {"id": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "address": "fa:16:3e:72:6c:0a", "network": {"id": "09ce33bb-a6a5-4182-827a-e37deb4119e3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215868819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e85b6b40e54b5e81ee9dabef1e6b1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d9ea6a-c8", "ovs_interfaceid": "e4d9ea6a-c873-44ba-93d3-21a5da11c826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG os_vif [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4d9ea6a-c8, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04aea177-fef6-4361-917d-e830362e745a) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:02 user nova-compute[74429]: INFO os_vif [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6c:0a,bridge_name='br-int',has_traffic_filtering=True,id=e4d9ea6a-c873-44ba-93d3-21a5da11c826,network=Network(09ce33bb-a6a5-4182-827a-e37deb4119e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d9ea6a-c8')
Oct 23 20:16:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Deleting instance files /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a_del
Oct 23 20:16:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Deletion of /opt/stack/data/nova/instances/3315b73b-413e-40f2-89bf-e285b13d702a_del complete
Oct 23 20:16:02 user nova-compute[74429]: INFO nova.compute.manager [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 20:16:02 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:16:02 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:03 user nova-compute[74429]: INFO nova.compute.manager [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Terminating instance
Oct 23 20:16:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:16:03 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Took 1.22 seconds to deallocate network for instance.
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-11d7e5c1-b9ff-43bb-b09b-cf7ebbd9098c req-329af35a-c1df-4241-b114-87fdfa0b4e0f service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-deleted-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Instance destroyed successfully.
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.objects.instance [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'resources' on Instance uuid 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2118326004',display_name='tempest-AttachVolumeTestJSON-server-2118326004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2118326004',id=16,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8vKpL1H9Jssacq2nktyIlquzVdrTPNLrKERLMQjSAadED4Pd2RCWBV5+S+EByyKkaI09AV/c/wXXe0Gr55ZSkxZGi6rq++ZzEuuscBtheudnUzQBJh6RNmEhHlxzH0lQ==',key_name='tempest-keypair-919163820',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-eyi2u0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=236ad665-9dd8-4cb3-85cd-35f1b6a26b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "address": "fa:16:3e:88:c1:97", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ec5a03-70", "ovs_interfaceid": "d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG os_vif [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ec5a03-70, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eda89582-9691-43db-a67b-a404234b8b8f) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received event network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Acquiring lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Lock "3315b73b-413e-40f2-89bf-e285b13d702a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] No waiting events found dispatching network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:04 user nova-compute[74429]: WARNING nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 3315b73b-413e-40f2-89bf-e285b13d702a] Received unexpected event network-vif-plugged-e4d9ea6a-c873-44ba-93d3-21a5da11c826 for instance with vm_state deleted and task_state None.
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:04 user nova-compute[74429]: WARNING nova.compute.manager [req-021d9dd0-be44-420e-9539-17eda0ded0ea req-c2afb02d-802e-4a9d-b4e7-688c7b1dbeb9 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state active and task_state deleting.
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:04 user nova-compute[74429]: INFO os_vif [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c1:97,bridge_name='br-int',has_traffic_filtering=True,id=d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ec5a03-70')
Oct 23 20:16:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Deleting instance files /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a_del
Oct 23 20:16:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Deletion of /opt/stack/data/nova/instances/236ad665-9dd8-4cb3-85cd-35f1b6a26b3a_del complete
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: INFO nova.compute.manager [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:16:04 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Deleted allocations for instance 3315b73b-413e-40f2-89bf-e285b13d702a
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b58ca89c-f6e3-4fb0-bfb1-b5b7a8b6d826 tempest-TaggedAttachmentsTest-1650713372 tempest-TaggedAttachmentsTest-1650713372-project-member] Lock "3315b73b-413e-40f2-89bf-e285b13d702a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-changed-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing instance network info cache due to event network-changed-fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] Acquiring lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] Acquired lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.network.neutron [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Refreshing network info cache for port fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:04 user nova-compute[74429]: INFO nova.compute.manager [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Terminating instance
Oct 23 20:16:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.network.neutron [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updated VIF entry in instance network info cache for port fac1362d-5d37-445e-9987-b454e179e242. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.network.neutron [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [{"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2e4d1982-8a56-4e02-91b9-ec722f4e2cce req-979c12f2-6e3b-4a7c-8ef2-e42e02505988 service nova] Releasing lock "refresh_cache-5b24653c-f35e-4aec-aa2c-d6cfd7616235" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:16:05 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Took 1.09 seconds to deallocate network for instance.
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Instance destroyed successfully.
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lazy-loading 'resources' on Instance uuid 5b24653c-f35e-4aec-aa2c-d6cfd7616235 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-324355928',display_name='tempest-TestShelveInstance-server-324355928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-324355928',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL30oSke4ymfv0vz3p+dU0Hgeeae4AXnkTUqMREfedOj5jG1lKgyUT58KwUuZ6jA16jrr2rDPrGJvzCN/JVopmhp7570pefp1faRM+cS+asPYB3Ohj8styGRIA2nCLuiA==',key_name='tempest-TestShelveInstance-1295653859',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4a64891d474410aacce30e403d2f625',ramdisk_id='',reservation_id='r-yngx7jwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1011766138',owner_user_name='tempest-TestShelveInstance-1011766138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:14:52Z,user_data=None,user_id='da9987f7f5024cb2b0094f1efd8fc942',uuid=5b24653c-f35e-4aec-aa2c-d6cfd7616235,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converting VIF {"id": "fac1362d-5d37-445e-9987-b454e179e242", "address": "fa:16:3e:7e:cb:70", "network": {"id": "a8c83e37-fcce-48cd-b975-013f90dbacce", "bridge": "br-int", "label": "tempest-TestShelveInstance-1517187661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a64891d474410aacce30e403d2f625", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac1362d-5d", "ovs_interfaceid": "fac1362d-5d37-445e-9987-b454e179e242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_vif [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfac1362d-5d, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a5948b1-c2f8-4d17-9541-7b7f29d57525) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:05 user nova-compute[74429]: INFO os_vif [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=fac1362d-5d37-445e-9987-b454e179e242,network=Network(a8c83e37-fcce-48cd-b975-013f90dbacce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac1362d-5d')
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCkMEvUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:16:05 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140c276-4561-46da-b286-8eca0dccb812]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:16:05 user nova-compute[74429]: No targets found.
Oct 23 20:16:05 user nova-compute[74429]: iSNS:
Oct 23 20:16:05 user nova-compute[74429]: No targets found.
Oct 23 20:16:05 user nova-compute[74429]: STATIC:
Oct 23 20:16:05 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596
Oct 23 20:16:05 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:16:05 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:16:05 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816
Oct 23 20:16:05 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:16:05 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:16:05 user nova-compute[74429]: FIRMWARE:
Oct 23 20:16:05 user nova-compute[74429]: No targets found.
Oct 23 20:16:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:16:05 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:16:05 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c473cffa-4523-4935-9631-4b0716b2545d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5649b109-dfa1-4d35-bea8-3afdcfafc8ef]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:05 user nova-compute[74429]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:16:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:05 user nova-compute[74429]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 (non-flash)
Oct 23 20:16:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c6cacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[44177515-8c83-4b46-a821-9c0c14910a56]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469f864-4b8c-4110-a138-292fad1ec64b]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872231e-b6c5-413b-a1a4-26d9ea1a5b22]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd31261-473b-4f4e-90b1-21ca332ba0dd]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6c0763-a382-4009-9b98-3a619fa3dd7c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:05 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Deleted allocations for instance 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[25282794-3083-4b76-97b8-50beadbfdd3e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260]
Oct 23 20:16:05 user nova-compute[74429]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596, portal: 172.16.0.220,3260] successful.
Oct 23 20:16:05 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ef0a13-d89b-44f4-822b-1cd41dadc596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1bdb22-60d8-4423-a380-8eece41ff18d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] <== disconnect_volume: return (330ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:16:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:16:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Deleting instance files /opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235_del
Oct 23 20:16:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Deletion of /opt/stack/data/nova/instances/5b24653c-f35e-4aec-aa2c-d6cfd7616235_del complete
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-90e3e248-d063-4765-9ce1-2ff54750b6e6 req-c213f35e-0583-445e-8b63-9eba03e851ba service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-deleted-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-51dc25c5-0601-4f00-a47b-3dcd58af1a1d tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: INFO nova.compute.manager [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:06 user nova-compute[74429]: WARNING nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state deleted and task_state None.
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:06 user nova-compute[74429]: WARNING nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state deleted and task_state None.
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:06 user nova-compute[74429]: WARNING nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-unplugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state deleted and task_state None.
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Acquiring lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] Lock "236ad665-9dd8-4cb3-85cd-35f1b6a26b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] No waiting events found dispatching network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:06 user nova-compute[74429]: WARNING nova.compute.manager [req-aa6f9cf6-c5fd-40ed-b3d4-a9dacf479d15 req-25a8c6f0-e5e0-46df-b947-e2b9485ef584 service nova] [instance: 236ad665-9dd8-4cb3-85cd-35f1b6a26b3a] Received unexpected event network-vif-plugged-d0ec5a03-7054-4e1a-9b13-cb5b0f5862ee for instance with vm_state deleted and task_state None.
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:16:06 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Took 0.49 seconds to deallocate network for instance.
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-unplugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-unplugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-unplugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] Acquiring lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] No waiting events found dispatching network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:06 user nova-compute[74429]: WARNING nova.compute.manager [req-91b583ae-f62b-41cf-ab13-06acbd411b1c req-53a09af6-8a29-4135-ac35-7b0fa1bdebaf service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received unexpected event network-vif-plugged-fac1362d-5d37-445e-9987-b454e179e242 for instance with vm_state active and task_state deleting.
Oct 23 20:16:07 user nova-compute[74429]: INFO nova.compute.manager [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Took 0.83 seconds to detach 1 volumes for instance.
Oct 23 20:16:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Deleting volume: 70ef0a13-d89b-44f4-822b-1cd41dadc596 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 20:16:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:07 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:16:07 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:16:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:07 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Deleted allocations for instance 5b24653c-f35e-4aec-aa2c-d6cfd7616235
Oct 23 20:16:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a611b898-b9ad-4ae6-8cd2-b77dad33bbe6 tempest-TestShelveInstance-1011766138 tempest-TestShelveInstance-1011766138-project-member] Lock "5b24653c-f35e-4aec-aa2c-d6cfd7616235" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-3326d6c4-0a0a-49cb-951d-b71822ab91e1 req-f63b1aea-d52c-4912-b778-d23ad802d667 service nova] [instance: 5b24653c-f35e-4aec-aa2c-d6cfd7616235] Received event network-vif-deleted-fac1362d-5d37-445e-9987-b454e179e242 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:09 user nova-compute[74429]: INFO nova.compute.manager [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Detaching volume 9fa6a87d-7aa3-4536-88b3-6c75c6a68816
Oct 23 20:16:09 user nova-compute[74429]: INFO nova.virt.block_device [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Attempting to driver detach volume 9fa6a87d-7aa3-4536-88b3-6c75c6a68816 from mountpoint /dev/vdc
Oct 23 20:16:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Attempting to detach device vdc from instance de91660d-61a1-4e58-a75d-8fed5386b6de from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:16:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:16:09 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:16:09 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:16:09 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:16:09 user nova-compute[74429]:   <serial>9fa6a87d-7aa3-4536-88b3-6c75c6a68816</serial>
Oct 23 20:16:09 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:16:09 user nova-compute[74429]: </disk>
Oct 23 20:16:09 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:16:09 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully detached device vdc from instance de91660d-61a1-4e58-a75d-8fed5386b6de from the persistent domain config.
Oct 23 20:16:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance de91660d-61a1-4e58-a75d-8fed5386b6de from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:16:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:16:09 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:16:09 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:16:09 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:16:09 user nova-compute[74429]:   <serial>9fa6a87d-7aa3-4536-88b3-6c75c6a68816</serial>
Oct 23 20:16:09 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:16:09 user nova-compute[74429]: </disk>
Oct 23 20:16:09 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:16:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:16:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:16:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:16:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Creating image(s)
Oct 23 20:16:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:16:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Ensure instance console log exists: /opt/stack/data/nova/instances/8f7a5779-cc71-45a3-8a1c-6c25ab5d2577/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Start _get_guest_xml network_info=[{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e1571c7e-d890-41a3-8631-f1fb18038357', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f7a5779-cc71-45a3-8a1c-6c25ab5d2577', 'attached_at': '', 'detached_at': '', 'volume_id': '711bc196-6062-46c7-a013-43a3f91a8ab7', 'serial': '711bc196-6062-46c7-a013-43a3f91a8ab7'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:16:11 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:16:11 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:16:11 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:16:11 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:16:11 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a045eb7a-326b-403a-92e8-0fddccb54592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:16:11 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab12a22-810e-4838-ab4d-60a019cc5a76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7] added
Oct 23 20:16:11 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afa2ba-381c-4bcd-ab69-5df6b95fd652]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ddf40-26b6-43a6-97bd-e1b806286078]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gifmUOFY {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gifmUOFY" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231323b-e345-428b-9a90-e88fe14734af]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gifmUOFY'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[be556134-e477-4586-b471-3a5c94954d17]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4a96b4-0f76-4273-bba3-0a4f8be82f12]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:11 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:11 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb097cb-9214-4819-bbe7-ef23051a877f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]
Oct 23 20:16:11 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.
Oct 23 20:16:11 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a74510d-e6fe-4211-9f94-de38806b8236]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5b77ad-d38e-4f79-8346-f4304347aaa5]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:11 user nova-compute[74429]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:16:11 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:11 user nova-compute[74429]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:16:11 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52c557-99a6-4dc5-8cdb-030d5d9bf1d2]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:11 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23934653939333463', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653939333463', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1052559067',display_name='tempest-ServerActionsTestOtherA-server-1052559067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1052559067',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-n54juhfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=8f7a5779-cc71-45a3-8a1c-6c25ab5d2577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:16:12 user nova-compute[74429]:   <uuid>8f7a5779-cc71-45a3-8a1c-6c25ab5d2577</uuid>
Oct 23 20:16:12 user nova-compute[74429]:   <name>instance-0000001d</name>
Oct 23 20:16:12 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:16:12 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:16:12 user nova-compute[74429]:   <metadata>
Oct 23 20:16:12 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:16:12 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:16:12 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherA-server-1052559067</nova:name>
Oct 23 20:16:12 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:16:11</nova:creationTime>
Oct 23 20:16:12 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:16:12 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:16:12 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:16:12 user nova-compute[74429]:       <nova:owner>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:user uuid="80ac3c2700c2447993ba5a8e14db0aa5">tempest-ServerActionsTestOtherA-1925715908-project-member</nova:user>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:project uuid="3f8768b24d954f5cbb03c242e6a3a1f1">tempest-ServerActionsTestOtherA-1925715908</nova:project>
Oct 23 20:16:12 user nova-compute[74429]:       </nova:owner>
Oct 23 20:16:12 user nova-compute[74429]:       <nova:ports>
Oct 23 20:16:12 user nova-compute[74429]:         <nova:port uuid="d0a97aae-567b-4f56-9860-6536c03f46c5">
Oct 23 20:16:12 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:16:12 user nova-compute[74429]:         </nova:port>
Oct 23 20:16:12 user nova-compute[74429]:       </nova:ports>
Oct 23 20:16:12 user nova-compute[74429]:     </nova:instance>
Oct 23 20:16:12 user nova-compute[74429]:   </metadata>
Oct 23 20:16:12 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:16:12 user nova-compute[74429]:     <system>
Oct 23 20:16:12 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:16:12 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:16:12 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:16:12 user nova-compute[74429]:       <entry name="serial">8f7a5779-cc71-45a3-8a1c-6c25ab5d2577</entry>
Oct 23 20:16:12 user nova-compute[74429]:       <entry name="uuid">8f7a5779-cc71-45a3-8a1c-6c25ab5d2577</entry>
Oct 23 20:16:12 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:16:12 user nova-compute[74429]:     </system>
Oct 23 20:16:12 user nova-compute[74429]:   </sysinfo>
Oct 23 20:16:12 user nova-compute[74429]:   <os>
Oct 23 20:16:12 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:16:12 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:16:12 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:16:12 user nova-compute[74429]:   </os>
Oct 23 20:16:12 user nova-compute[74429]:   <features>
Oct 23 20:16:12 user nova-compute[74429]:     <acpi/>
Oct 23 20:16:12 user nova-compute[74429]:     <apic/>
Oct 23 20:16:12 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:16:12 user nova-compute[74429]:   </features>
Oct 23 20:16:12 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:16:12 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:16:12 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:16:12 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:16:12 user nova-compute[74429]:   </clock>
Oct 23 20:16:12 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:16:12 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:16:12 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:16:12 user nova-compute[74429]:   </cpu>
Oct 23 20:16:12 user nova-compute[74429]:   <devices>
Oct 23 20:16:12 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:16:12 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:16:12 user nova-compute[74429]:       <source dev="/dev/sdc"/>
Oct 23 20:16:12 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:16:12 user nova-compute[74429]:       <serial>711bc196-6062-46c7-a013-43a3f91a8ab7</serial>
Oct 23 20:16:12 user nova-compute[74429]:     </disk>
Oct 23 20:16:12 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:16:12 user nova-compute[74429]:       <mac address="fa:16:3e:eb:ed:aa"/>
Oct 23 20:16:12 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:16:12 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:16:12 user nova-compute[74429]:       <target dev="tapd0a97aae-56"/>
Oct 23 20:16:12 user nova-compute[74429]:     </interface>
Oct 23 20:16:12 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:16:12 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/8f7a5779-cc71-45a3-8a1c-6c25ab5d2577/console.log" append="off"/>
Oct 23 20:16:12 user nova-compute[74429]:     </serial>
Oct 23 20:16:12 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:16:12 user nova-compute[74429]:     <video>
Oct 23 20:16:12 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:16:12 user nova-compute[74429]:     </video>
Oct 23 20:16:12 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:16:12 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:16:12 user nova-compute[74429]:     </rng>
Oct 23 20:16:12 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:16:12 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:16:12 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:16:12 user nova-compute[74429]:     </memballoon>
Oct 23 20:16:12 user nova-compute[74429]:   </devices>
Oct 23 20:16:12 user nova-compute[74429]: </domain>
Oct 23 20:16:12 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1052559067',display_name='tempest-ServerActionsTestOtherA-server-1052559067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1052559067',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-n54juhfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=8f7a5779-cc71-45a3-8a1c-6c25ab5d2577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG os_vif [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12296500-a43a-53e2-80fc-ae58261abb6f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0a97aae-56, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0a97aae-56, col_values=(('qos', UUID('0f62e225-e984-4196-bfac-215d8085bb94')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0a97aae-56, col_values=(('external_ids', {'iface-id': 'd0a97aae-567b-4f56-9860-6536c03f46c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:ed:aa', 'vm-uuid': '8f7a5779-cc71-45a3-8a1c-6c25ab5d2577'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:12 user nova-compute[74429]: INFO os_vif [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56')
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:16:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No VIF found with MAC fa:16:3e:eb:ed:aa, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-aafd2eb9-dac0-465a-b8ef-0ae23f042974 req-e6fffc24-3f7a-48b8-98b5-cf2eb5a21ae8 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aafd2eb9-dac0-465a-b8ef-0ae23f042974 req-e6fffc24-3f7a-48b8-98b5-cf2eb5a21ae8 service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aafd2eb9-dac0-465a-b8ef-0ae23f042974 req-e6fffc24-3f7a-48b8-98b5-cf2eb5a21ae8 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-aafd2eb9-dac0-465a-b8ef-0ae23f042974 req-e6fffc24-3f7a-48b8-98b5-cf2eb5a21ae8 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-aafd2eb9-dac0-465a-b8ef-0ae23f042974 req-e6fffc24-3f7a-48b8-98b5-cf2eb5a21ae8 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:13 user nova-compute[74429]: WARNING nova.compute.manager [req-aafd2eb9-dac0-465a-b8ef-0ae23f042974 req-e6fffc24-3f7a-48b8-98b5-cf2eb5a21ae8 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state building and task_state spawning.
Oct 23 20:16:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:16:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance spawned successfully.
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:16:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:16:16 user nova-compute[74429]: INFO nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Took 5.00 seconds to spawn the instance on the hypervisor.
Oct 23 20:16:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:16:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-0fd7b99b-a412-47ff-ad66-70e48539e279 req-57d0760c-9e0b-41aa-b4ca-8d639ced035e service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0fd7b99b-a412-47ff-ad66-70e48539e279 req-57d0760c-9e0b-41aa-b4ca-8d639ced035e service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0fd7b99b-a412-47ff-ad66-70e48539e279 req-57d0760c-9e0b-41aa-b4ca-8d639ced035e service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0fd7b99b-a412-47ff-ad66-70e48539e279 req-57d0760c-9e0b-41aa-b4ca-8d639ced035e service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-0fd7b99b-a412-47ff-ad66-70e48539e279 req-57d0760c-9e0b-41aa-b4ca-8d639ced035e service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:16:16 user nova-compute[74429]: WARNING nova.compute.manager [req-0fd7b99b-a412-47ff-ad66-70e48539e279 req-57d0760c-9e0b-41aa-b4ca-8d639ced035e service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state building and task_state spawning.
Oct 23 20:16:16 user nova-compute[74429]: INFO nova.compute.manager [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Took 32.92 seconds to build instance.
Oct 23 20:16:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c8261ccc-8428-4554-b54c-633d2450cbbc tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.018s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:20 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:16:21 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:16:24 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8101MB free_disk=25.435401916503906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance de91660d-61a1-4e58-a75d-8fed5386b6de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:16:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:16:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:16:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:16:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:16:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updating instance_info_cache with network_info: [{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:16:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:16:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:16:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:30 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance de91660d-61a1-4e58-a75d-8fed5386b6de is timed out.
Oct 23 20:16:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully detached device vdc from instance de91660d-61a1-4e58-a75d-8fed5386b6de from the live domain config.
Oct 23 20:16:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRmAFGCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:16:30 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b7c63-6bc9-4812-97d5-6d5e50af9e7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:16:30 user nova-compute[74429]: No targets found.
Oct 23 20:16:30 user nova-compute[74429]: iSNS:
Oct 23 20:16:30 user nova-compute[74429]: No targets found.
Oct 23 20:16:30 user nova-compute[74429]: STATIC:
Oct 23 20:16:30 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816
Oct 23 20:16:30 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:16:30 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:16:30 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7
Oct 23 20:16:30 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:16:30 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:16:30 user nova-compute[74429]: FIRMWARE:
Oct 23 20:16:30 user nova-compute[74429]: No targets found.
Oct 23 20:16:30 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:16:30 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:16:30 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db3850-1d0a-4de8-b36e-ff2ccc664f40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762541c-37df-4976-9fde-982126f99523]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:30 user nova-compute[74429]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:16:30 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 (non-flash)
Oct 23 20:16:30 user nova-compute[74429]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:16:30 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50599bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e6075-089b-4c7b-b3f0-b94afdf29e67]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7107d717-e547-492f-afc7-7a67e438566e]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91c84e-178d-4e0d-846e-5bfbe745f513]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8918b1-21f8-44f1-bdc9-ce181c394b71]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c98b8-05c7-4059-bc3a-76fddb978883]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca2f42-97ad-47f5-97f3-1bfe9f6da0b5]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260]
Oct 23 20:16:30 user nova-compute[74429]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816, portal: 172.16.0.220,3260] successful.
Oct 23 20:16:30 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa6a87d-7aa3-4536-88b3-6c75c6a68816 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45b40f5-e1d6-4b16-8f28-9e386db286e9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] <== disconnect_volume: return (277ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:16:31 user nova-compute[74429]: DEBUG nova.objects.instance [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'flavor' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:16:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-848d04f4-747c-4eae-97d8-8982db06d4cd tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.748s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:16:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:16:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:16:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:16:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:16:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:16:57 user nova-compute[74429]: INFO nova.compute.claims [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Claim successful on node user
Oct 23 20:16:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.network.neutron [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:16:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:16:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Creating image(s)
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "/opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "/opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "/opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG nova.policy [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce4aa1886f044d3bb7c952632b48047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4121e72c37c4fa5acfd0f568fc1153d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk 1073741824" returned: 0 in 0.058s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.237s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Successfully created port: 5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Cannot resize image /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Ensure instance console log exists: /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Successfully updated port: 5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquired lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-changed-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Refreshing instance network info cache due to event network-changed-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] Acquiring lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:16:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updating instance_info_cache with network_info: [{"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Releasing lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Instance network_info: |[{"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:17:00 user nova-compute[74429]: INFO nova.compute.manager [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Terminating instance
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] Acquired lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Refreshing network info cache for port 5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Start _get_guest_xml network_info=[{"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:17:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1879463098',display_name='tempest-AttachVolumeTestJSON-server-1879463098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1879463098',id=30,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLggpL+5VlWCaB8PztPkgNu2N9UdO+mukkrKI/+QtY2urShNXoJfy/jBJZRyyrJUCDE0KfUgpjmOpR3lPNrDAE0dpNtczQKRcpXm8ZYMOpJFgvrhABJgg2voukCcr39ORQ==',key_name='tempest-keypair-1141036858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-rty5c93c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=242115af-9810-43e9-8ebc-804f4d0069e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'pci_devices' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:17:00 user nova-compute[74429]:   <uuid>242115af-9810-43e9-8ebc-804f4d0069e4</uuid>
Oct 23 20:17:00 user nova-compute[74429]:   <name>instance-0000001e</name>
Oct 23 20:17:00 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:17:00 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:17:00 user nova-compute[74429]:   <metadata>
Oct 23 20:17:00 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:17:00 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:17:00 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeTestJSON-server-1879463098</nova:name>
Oct 23 20:17:00 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:17:00</nova:creationTime>
Oct 23 20:17:00 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:17:00 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:17:00 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:17:00 user nova-compute[74429]:       <nova:owner>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:user uuid="9ce4aa1886f044d3bb7c952632b48047">tempest-AttachVolumeTestJSON-1733625309-project-member</nova:user>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:project uuid="f4121e72c37c4fa5acfd0f568fc1153d">tempest-AttachVolumeTestJSON-1733625309</nova:project>
Oct 23 20:17:00 user nova-compute[74429]:       </nova:owner>
Oct 23 20:17:00 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:17:00 user nova-compute[74429]:       <nova:ports>
Oct 23 20:17:00 user nova-compute[74429]:         <nova:port uuid="5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf">
Oct 23 20:17:00 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 20:17:00 user nova-compute[74429]:         </nova:port>
Oct 23 20:17:00 user nova-compute[74429]:       </nova:ports>
Oct 23 20:17:00 user nova-compute[74429]:     </nova:instance>
Oct 23 20:17:00 user nova-compute[74429]:   </metadata>
Oct 23 20:17:00 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:17:00 user nova-compute[74429]:     <system>
Oct 23 20:17:00 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:17:00 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:17:00 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:17:00 user nova-compute[74429]:       <entry name="serial">242115af-9810-43e9-8ebc-804f4d0069e4</entry>
Oct 23 20:17:00 user nova-compute[74429]:       <entry name="uuid">242115af-9810-43e9-8ebc-804f4d0069e4</entry>
Oct 23 20:17:00 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:17:00 user nova-compute[74429]:     </system>
Oct 23 20:17:00 user nova-compute[74429]:   </sysinfo>
Oct 23 20:17:00 user nova-compute[74429]:   <os>
Oct 23 20:17:00 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:17:00 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:17:00 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:17:00 user nova-compute[74429]:   </os>
Oct 23 20:17:00 user nova-compute[74429]:   <features>
Oct 23 20:17:00 user nova-compute[74429]:     <acpi/>
Oct 23 20:17:00 user nova-compute[74429]:     <apic/>
Oct 23 20:17:00 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:17:00 user nova-compute[74429]:   </features>
Oct 23 20:17:00 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:17:00 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:17:00 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:17:00 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:17:00 user nova-compute[74429]:   </clock>
Oct 23 20:17:00 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:17:00 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:17:00 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:17:00 user nova-compute[74429]:   </cpu>
Oct 23 20:17:00 user nova-compute[74429]:   <devices>
Oct 23 20:17:00 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:17:00 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:17:00 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk"/>
Oct 23 20:17:00 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:17:00 user nova-compute[74429]:     </disk>
Oct 23 20:17:00 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:17:00 user nova-compute[74429]:       <mac address="fa:16:3e:bd:5b:1d"/>
Oct 23 20:17:00 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:00 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:17:00 user nova-compute[74429]:       <target dev="tap5f4a431d-fd"/>
Oct 23 20:17:00 user nova-compute[74429]:     </interface>
Oct 23 20:17:00 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:17:00 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/console.log" append="off"/>
Oct 23 20:17:00 user nova-compute[74429]:     </serial>
Oct 23 20:17:00 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:17:00 user nova-compute[74429]:     <video>
Oct 23 20:17:00 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:00 user nova-compute[74429]:     </video>
Oct 23 20:17:00 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:17:00 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:17:00 user nova-compute[74429]:     </rng>
Oct 23 20:17:00 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:17:00 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:17:00 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:17:00 user nova-compute[74429]:     </memballoon>
Oct 23 20:17:00 user nova-compute[74429]:   </devices>
Oct 23 20:17:00 user nova-compute[74429]: </domain>
Oct 23 20:17:00 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1879463098',display_name='tempest-AttachVolumeTestJSON-server-1879463098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1879463098',id=30,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLggpL+5VlWCaB8PztPkgNu2N9UdO+mukkrKI/+QtY2urShNXoJfy/jBJZRyyrJUCDE0KfUgpjmOpR3lPNrDAE0dpNtczQKRcpXm8ZYMOpJFgvrhABJgg2voukCcr39ORQ==',key_name='tempest-keypair-1141036858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-rty5c93c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=242115af-9810-43e9-8ebc-804f4d0069e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG os_vif [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3730f996-1e11-5cd9-a807-62f70f6f6f68', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f4a431d-fd, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f4a431d-fd, col_values=(('qos', UUID('9b73951e-e9a7-4398-92cc-cdecf8aaa5f1')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f4a431d-fd, col_values=(('external_ids', {'iface-id': '5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:5b:1d', 'vm-uuid': '242115af-9810-43e9-8ebc-804f4d0069e4'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:00 user nova-compute[74429]: INFO os_vif [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd')
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No VIF found with MAC fa:16:3e:bd:5b:1d, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0e52d5a-7aa7-4645-8228-a94319023616 req-6de49e6f-55cf-4542-ac9a-126359728bfa service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-unplugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0e52d5a-7aa7-4645-8228-a94319023616 req-6de49e6f-55cf-4542-ac9a-126359728bfa service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0e52d5a-7aa7-4645-8228-a94319023616 req-6de49e6f-55cf-4542-ac9a-126359728bfa service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a0e52d5a-7aa7-4645-8228-a94319023616 req-6de49e6f-55cf-4542-ac9a-126359728bfa service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0e52d5a-7aa7-4645-8228-a94319023616 req-6de49e6f-55cf-4542-ac9a-126359728bfa service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-unplugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-a0e52d5a-7aa7-4645-8228-a94319023616 req-6de49e6f-55cf-4542-ac9a-126359728bfa service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-unplugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updated VIF entry in instance network info cache for port 5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updating instance_info_cache with network_info: [{"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-df1ceb41-5523-47bf-88a6-4387272c52b2 req-c4a1b409-dda5-4313-81d2-104527aace0c service nova] Releasing lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Instance destroyed successfully.
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'resources' on Instance uuid de91660d-61a1-4e58-a75d-8fed5386b6de {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-484815685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-484815685',id=24,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIhi7GEHDm9o+sD3rEkCWx650rr/AtW//YwSwASR0/JSk98CdjaUsTSUGFMNwA5wN8lur+M/btid/agHB9nMoAuQU3xIB4GLFaeid2O7TMdil3U3nKW+txvk0hJjaH0fQ==',key_name='tempest-keypair-383380181',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-xfgweb4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=de91660d-61a1-4e58-a75d-8fed5386b6de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "address": "fa:16:3e:16:e2:c8", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a399db8-c2", "ovs_interfaceid": "7a399db8-c2da-4bd4-84a1-37a1155a1912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG os_vif [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a399db8-c2, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b9f81cc-95bc-4ec1-99d7-4cfccdb8b000) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:01 user nova-compute[74429]: INFO os_vif [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e2:c8,bridge_name='br-int',has_traffic_filtering=True,id=7a399db8-c2da-4bd4-84a1-37a1155a1912,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a399db8-c2')
Oct 23 20:17:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Deleting instance files /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de_del
Oct 23 20:17:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Deletion of /opt/stack/data/nova/instances/de91660d-61a1-4e58-a75d-8fed5386b6de_del complete
Oct 23 20:17:01 user nova-compute[74429]: INFO nova.compute.manager [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 23 20:17:01 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:17:01 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:02 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Took 0.77 seconds to deallocate network for instance.
Oct 23 20:17:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-51c320a8-8100-4fd2-a310-10f8c132b7cc req-fcc4b352-5cca-45fb-a7cf-48354126237d service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-deleted-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-f7c5933e-236a-4cc0-8649-cbc32087a64f req-b0078a4a-538f-4bf3-bdc7-79f486cda7b0 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f7c5933e-236a-4cc0-8649-cbc32087a64f req-b0078a4a-538f-4bf3-bdc7-79f486cda7b0 service nova] Acquiring lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f7c5933e-236a-4cc0-8649-cbc32087a64f req-b0078a4a-538f-4bf3-bdc7-79f486cda7b0 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f7c5933e-236a-4cc0-8649-cbc32087a64f req-b0078a4a-538f-4bf3-bdc7-79f486cda7b0 service nova] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-f7c5933e-236a-4cc0-8649-cbc32087a64f req-b0078a4a-538f-4bf3-bdc7-79f486cda7b0 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] No waiting events found dispatching network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:02 user nova-compute[74429]: WARNING nova.compute.manager [req-f7c5933e-236a-4cc0-8649-cbc32087a64f req-b0078a4a-538f-4bf3-bdc7-79f486cda7b0 service nova] [instance: de91660d-61a1-4e58-a75d-8fed5386b6de] Received unexpected event network-vif-plugged-7a399db8-c2da-4bd4-84a1-37a1155a1912 for instance with vm_state deleted and task_state None.
Oct 23 20:17:02 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:02 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Deleted allocations for instance de91660d-61a1-4e58-a75d-8fed5386b6de
Oct 23 20:17:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b92ee1b7-621e-4566-ada6-9486dbc11f7c tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "de91660d-61a1-4e58-a75d-8fed5386b6de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.757s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:17:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Instance spawned successfully.
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:04 user nova-compute[74429]: WARNING nova.compute.manager [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state building and task_state spawning.
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:04 user nova-compute[74429]: WARNING nova.compute.manager [req-a562802b-7bba-425a-938f-f5c947d518b2 req-fd6f9c22-0de5-428a-b663-d6e809c91f67 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state building and task_state spawning.
Oct 23 20:17:04 user nova-compute[74429]: INFO nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 23 20:17:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:17:04 user nova-compute[74429]: INFO nova.compute.manager [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Took 6.77 seconds to build instance.
Oct 23 20:17:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fa256397-90aa-4157-ae4f-5c9c943253bb tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.873s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:16 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:17:16 user nova-compute[74429]: INFO nova.compute.claims [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Claim successful on node user
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:17:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.policy [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c660b1cec6dd476aa14a3d0fb74ebd4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb9beb49ad42fbaf6d07c88babe563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:17:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Creating image(s)
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk 1073741824" returned: 0 in 0.070s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:17 user nova-compute[74429]: DEBUG nova.network.neutron [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Successfully created port: 031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.218s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Cannot resize image /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Ensure instance console log exists: /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Successfully updated port: 031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing instance network info cache due to event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance network_info: |[{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.network.neutron [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Start _get_guest_xml network_info=[{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:17:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:18 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:17:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1037066447',display_name='tempest-ServerRescueNegativeTestJSON-server-1037066447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1037066447',id=31,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwFn5JPNee3X1sxsdYNzK74zVoN6EDJFv00X3A9JTtBfOGcU4p/W0FbxvUwxrVuUp62R9t/tz+fskvkTmhA5LulvkXZiK+Rb4nvvNcYh8X03BNLWX+SipLJptGVIDIx0w==',key_name='tempest-keypair-1915459799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-ld4nsqvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=46650715-39f9-4753-a858-8f81ba2c24d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.objects.instance [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'pci_devices' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:17:19 user nova-compute[74429]:   <uuid>46650715-39f9-4753-a858-8f81ba2c24d5</uuid>
Oct 23 20:17:19 user nova-compute[74429]:   <name>instance-0000001f</name>
Oct 23 20:17:19 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:17:19 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:17:19 user nova-compute[74429]:   <metadata>
Oct 23 20:17:19 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:17:19 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:17:19 user nova-compute[74429]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1037066447</nova:name>
Oct 23 20:17:19 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:17:18</nova:creationTime>
Oct 23 20:17:19 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:17:19 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:17:19 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:17:19 user nova-compute[74429]:       <nova:owner>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:user uuid="c660b1cec6dd476aa14a3d0fb74ebd4a">tempest-ServerRescueNegativeTestJSON-1224059578-project-member</nova:user>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:project uuid="9dbb9beb49ad42fbaf6d07c88babe563">tempest-ServerRescueNegativeTestJSON-1224059578</nova:project>
Oct 23 20:17:19 user nova-compute[74429]:       </nova:owner>
Oct 23 20:17:19 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:17:19 user nova-compute[74429]:       <nova:ports>
Oct 23 20:17:19 user nova-compute[74429]:         <nova:port uuid="031e39fe-e85e-4156-8f81-9e8341ffa00c">
Oct 23 20:17:19 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 20:17:19 user nova-compute[74429]:         </nova:port>
Oct 23 20:17:19 user nova-compute[74429]:       </nova:ports>
Oct 23 20:17:19 user nova-compute[74429]:     </nova:instance>
Oct 23 20:17:19 user nova-compute[74429]:   </metadata>
Oct 23 20:17:19 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:17:19 user nova-compute[74429]:     <system>
Oct 23 20:17:19 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:17:19 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:17:19 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:17:19 user nova-compute[74429]:       <entry name="serial">46650715-39f9-4753-a858-8f81ba2c24d5</entry>
Oct 23 20:17:19 user nova-compute[74429]:       <entry name="uuid">46650715-39f9-4753-a858-8f81ba2c24d5</entry>
Oct 23 20:17:19 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:17:19 user nova-compute[74429]:     </system>
Oct 23 20:17:19 user nova-compute[74429]:   </sysinfo>
Oct 23 20:17:19 user nova-compute[74429]:   <os>
Oct 23 20:17:19 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:17:19 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:17:19 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:17:19 user nova-compute[74429]:   </os>
Oct 23 20:17:19 user nova-compute[74429]:   <features>
Oct 23 20:17:19 user nova-compute[74429]:     <acpi/>
Oct 23 20:17:19 user nova-compute[74429]:     <apic/>
Oct 23 20:17:19 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:17:19 user nova-compute[74429]:   </features>
Oct 23 20:17:19 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:17:19 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:17:19 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:17:19 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:17:19 user nova-compute[74429]:   </clock>
Oct 23 20:17:19 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:17:19 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:17:19 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:17:19 user nova-compute[74429]:   </cpu>
Oct 23 20:17:19 user nova-compute[74429]:   <devices>
Oct 23 20:17:19 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:17:19 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:17:19 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk"/>
Oct 23 20:17:19 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:17:19 user nova-compute[74429]:     </disk>
Oct 23 20:17:19 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:17:19 user nova-compute[74429]:       <mac address="fa:16:3e:db:5d:9a"/>
Oct 23 20:17:19 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:19 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:17:19 user nova-compute[74429]:       <target dev="tap031e39fe-e8"/>
Oct 23 20:17:19 user nova-compute[74429]:     </interface>
Oct 23 20:17:19 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:17:19 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/console.log" append="off"/>
Oct 23 20:17:19 user nova-compute[74429]:     </serial>
Oct 23 20:17:19 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:17:19 user nova-compute[74429]:     <video>
Oct 23 20:17:19 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:19 user nova-compute[74429]:     </video>
Oct 23 20:17:19 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:17:19 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:17:19 user nova-compute[74429]:     </rng>
Oct 23 20:17:19 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:17:19 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:17:19 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:17:19 user nova-compute[74429]:     </memballoon>
Oct 23 20:17:19 user nova-compute[74429]:   </devices>
Oct 23 20:17:19 user nova-compute[74429]: </domain>
Oct 23 20:17:19 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1037066447',display_name='tempest-ServerRescueNegativeTestJSON-server-1037066447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1037066447',id=31,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwFn5JPNee3X1sxsdYNzK74zVoN6EDJFv00X3A9JTtBfOGcU4p/W0FbxvUwxrVuUp62R9t/tz+fskvkTmhA5LulvkXZiK+Rb4nvvNcYh8X03BNLWX+SipLJptGVIDIx0w==',key_name='tempest-keypair-1915459799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-ld4nsqvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=46650715-39f9-4753-a858-8f81ba2c24d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG os_vif [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c57cd91-6b4d-50a5-bdd6-010d490ca416', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap031e39fe-e8, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap031e39fe-e8, col_values=(('qos', UUID('0e97c9ea-6dc4-4115-ba9d-c682a62e909a')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap031e39fe-e8, col_values=(('external_ids', {'iface-id': '031e39fe-e85e-4156-8f81-9e8341ffa00c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:5d:9a', 'vm-uuid': '46650715-39f9-4753-a858-8f81ba2c24d5'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:19 user nova-compute[74429]: INFO os_vif [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8')
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:db:5d:9a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updated VIF entry in instance network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4dd1a5b3-6b7b-4bf2-8e63-cdab46749261 req-246d5709-db5c-41ca-8d3c-25e416463512 service nova] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-58f404a7-0cea-43aa-ae7b-2861e013e6f1 req-38c57334-c862-400c-9c3d-d437d11f227e service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58f404a7-0cea-43aa-ae7b-2861e013e6f1 req-38c57334-c862-400c-9c3d-d437d11f227e service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58f404a7-0cea-43aa-ae7b-2861e013e6f1 req-38c57334-c862-400c-9c3d-d437d11f227e service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-58f404a7-0cea-43aa-ae7b-2861e013e6f1 req-38c57334-c862-400c-9c3d-d437d11f227e service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-58f404a7-0cea-43aa-ae7b-2861e013e6f1 req-38c57334-c862-400c-9c3d-d437d11f227e service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:20 user nova-compute[74429]: WARNING nova.compute.manager [req-58f404a7-0cea-43aa-ae7b-2861e013e6f1 req-38c57334-c862-400c-9c3d-d437d11f227e service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state building and task_state spawning.
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:17:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance spawned successfully.
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:22 user nova-compute[74429]: INFO nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-275d63fd-b40d-450e-93b6-2ddd2a8804ee req-aada3b58-5b3b-4cb8-b583-8fd11c3e5a01 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-275d63fd-b40d-450e-93b6-2ddd2a8804ee req-aada3b58-5b3b-4cb8-b583-8fd11c3e5a01 service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-275d63fd-b40d-450e-93b6-2ddd2a8804ee req-aada3b58-5b3b-4cb8-b583-8fd11c3e5a01 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-275d63fd-b40d-450e-93b6-2ddd2a8804ee req-aada3b58-5b3b-4cb8-b583-8fd11c3e5a01 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-275d63fd-b40d-450e-93b6-2ddd2a8804ee req-aada3b58-5b3b-4cb8-b583-8fd11c3e5a01 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:22 user nova-compute[74429]: WARNING nova.compute.manager [req-275d63fd-b40d-450e-93b6-2ddd2a8804ee req-aada3b58-5b3b-4cb8-b583-8fd11c3e5a01 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state building and task_state spawning.
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:22 user nova-compute[74429]: INFO nova.compute.manager [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Took 6.03 seconds to build instance.
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4d623f1a-de09-4330-94b2-a43f374a7902 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.150s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:17:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:26 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:26 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8076MB free_disk=25.42319107055664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 242115af-9810-43e9-8ebc-804f4d0069e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:17:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:17:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Updating instance_info_cache with network_info: [{"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-bea3939d-9184-4ca5-aa4a-dba0a1be6af8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:17:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-changed-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Refreshing instance network info cache due to event network-changed-f2a7aa16-4b78-440a-a815-9865852163a7. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Refreshing network info cache for port f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updated VIF entry in instance network info cache for port f2a7aa16-4b78-440a-a815-9865852163a7. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-62571772-29de-4f50-a187-707bb4c0ef39 req-3e2caf49-dd5e-4ffd-b153-8a94c65b8be1 service nova] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-changed-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Refreshing instance network info cache due to event network-changed-d0a97aae-567b-4f56-9860-6536c03f46c5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Refreshing network info cache for port d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Stashing vm_state: active {{(pid=74429) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:17:36 user nova-compute[74429]: INFO nova.compute.claims [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Claim successful on node user
Oct 23 20:17:36 user nova-compute[74429]: INFO nova.compute.resource_tracker [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating resource usage from migration 7c98d3a2-97a9-4b79-bb9d-0b533c919e20
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updated VIF entry in instance network info cache for port d0a97aae-567b-4f56-9860-6536c03f46c5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-28ccca93-0cb6-44f1-bd08-3a50df3030c3 req-06299236-b6ea-4ff2-be6a-26fa8ff2ca2d service nova] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.379s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:36 user nova-compute[74429]: INFO nova.compute.manager [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Migrating
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:36 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Starting migrate_disk_and_power_off {{(pid=74429) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-afa6044f-4fa0-4faa-ac97-1c1e01ae32ca req-4e182ba8-7773-4010-aea4-d1c9944a8187 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-unplugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-afa6044f-4fa0-4faa-ac97-1c1e01ae32ca req-4e182ba8-7773-4010-aea4-d1c9944a8187 service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-afa6044f-4fa0-4faa-ac97-1c1e01ae32ca req-4e182ba8-7773-4010-aea4-d1c9944a8187 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-afa6044f-4fa0-4faa-ac97-1c1e01ae32ca req-4e182ba8-7773-4010-aea4-d1c9944a8187 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-afa6044f-4fa0-4faa-ac97-1c1e01ae32ca req-4e182ba8-7773-4010-aea4-d1c9944a8187 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-unplugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:37 user nova-compute[74429]: WARNING nova.compute.manager [req-afa6044f-4fa0-4faa-ac97-1c1e01ae32ca req-4e182ba8-7773-4010-aea4-d1c9944a8187 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-unplugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state active and task_state resize_migrating.
Oct 23 20:17:38 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance destroyed successfully.
Oct 23 20:17:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1052559067',display_name='tempest-ServerActionsTestOtherA-server-1052559067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1052559067',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-n54juhfi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=8f7a5779-cc71-45a3-8a1c-6c25ab5d2577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0a97aae-56, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f62e225-e984-4196-bfac-215d8085bb94) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: INFO os_vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56')
Oct 23 20:17:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:17:38 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b37d66-cd23-45ad-8b89-affd7ec796c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:17:38 user nova-compute[74429]: No targets found.
Oct 23 20:17:38 user nova-compute[74429]: iSNS:
Oct 23 20:17:38 user nova-compute[74429]: No targets found.
Oct 23 20:17:38 user nova-compute[74429]: STATIC:
Oct 23 20:17:38 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7
Oct 23 20:17:38 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:17:38 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:17:38 user nova-compute[74429]: FIRMWARE:
Oct 23 20:17:38 user nova-compute[74429]: No targets found.
Oct 23 20:17:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:17:38 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:17:38 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ed9704-5ffc-4344-bd69-1112a6baea9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed9344-a518-43a8-a865-b1a3c15c3e7a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:17:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:17:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d582292d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f7670a-fe0c-45f5-9b53-3f0a3b065289]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ac9d1-31f9-414b-979a-2f80475f6ae9]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6169d71-73f0-4a55-a6b8-1c3c5d240258]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848c6b7-79f7-47e8-a596-7694969178d8]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23934653939333463', '/dev/disk/by-id/scsi-1SCST_BIO2ed4329b-94e9934c1de968ac', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ed4329b') {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1340034f-1451-4d54-b244-d9f4634ab0af]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[65887f76-4576-4adf-88e0-baea9db54536]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0780bb-6523-4afb-af68-3a2e569f1622]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]
Oct 23 20:17:38 user nova-compute[74429]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.
Oct 23 20:17:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[797671a3-b2d1-4eda-a5af-bcf18f39191c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== disconnect_volume: return (347ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:17:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:17:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-e1cefc37-825b-46f0-b05a-efebb6c6716e req-0c438b38-ced4-4731-80e6-c096a4478451 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e1cefc37-825b-46f0-b05a-efebb6c6716e req-0c438b38-ced4-4731-80e6-c096a4478451 service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e1cefc37-825b-46f0-b05a-efebb6c6716e req-0c438b38-ced4-4731-80e6-c096a4478451 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e1cefc37-825b-46f0-b05a-efebb6c6716e req-0c438b38-ced4-4731-80e6-c096a4478451 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-e1cefc37-825b-46f0-b05a-efebb6c6716e req-0c438b38-ced4-4731-80e6-c096a4478451 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:40 user nova-compute[74429]: WARNING nova.compute.manager [req-e1cefc37-825b-46f0-b05a-efebb6c6716e req-0c438b38-ced4-4731-80e6-c096a4478451 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state active and task_state resize_migrating.
Oct 23 20:17:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Port d0a97aae-567b-4f56-9860-6536c03f46c5 binding to destination host user is already ACTIVE {{(pid=74429) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG os_brick.utils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdd0f8b-720c-4871-9169-b74a34777876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e66ecbd-169c-48b9-9c09-bf2274b521b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbbbe1f-2e44-40d3-b294-50b67b029966]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[42adcfab-7d36-46a1-b93d-7257cfc4936c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:17:45 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:17:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3c4cf-7a94-4d6c-adc3-76a10c7dc2e1]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:17:45 user nova-compute[74429]: DEBUG os_brick.utils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:17:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:17:48 user nova-compute[74429]: INFO nova.compute.claims [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Claim successful on node user
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:17:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.policy [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b0353aaafb4bd684e02d8f95a98a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ae5527b83945b7a104641c9f813ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:17:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Creating image(s)
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "/opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "/opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "/opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Successfully created port: 004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk 1073741824" returned: 0 in 0.065s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Cannot resize image /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Ensure instance console log exists: /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Successfully updated port: 004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "refresh_cache-59436a9c-f149-4c99-8a20-59382b84b1ac" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquired lock "refresh_cache-59436a9c-f149-4c99-8a20-59382b84b1ac" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-changed-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Refreshing instance network info cache due to event network-changed-004eb1f2-dfd8-421d-98f0-33e64b9fd045. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] Acquiring lock "refresh_cache-59436a9c-f149-4c99-8a20-59382b84b1ac" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Updating instance_info_cache with network_info: [{"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Releasing lock "refresh_cache-59436a9c-f149-4c99-8a20-59382b84b1ac" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Instance network_info: |[{"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] Acquired lock "refresh_cache-59436a9c-f149-4c99-8a20-59382b84b1ac" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Refreshing network info cache for port 004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Start _get_guest_xml network_info=[{"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:17:50 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:50 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1541605297',display_name='tempest-VolumesActionsTest-instance-1541605297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1541605297',id=32,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ae5527b83945b7a104641c9f813ffb',ramdisk_id='',reservation_id='r-qe13stij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-765381540',owner_user_name='tempest-VolumesActionsTest-765381540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:49Z,user_data=None,user_id='43b0353aaafb4bd684e02d8f95a98a76',uuid=59436a9c-f149-4c99-8a20-59382b84b1ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Converting VIF {"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lazy-loading 'pci_devices' on Instance uuid 59436a9c-f149-4c99-8a20-59382b84b1ac {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:17:50 user nova-compute[74429]:   <uuid>59436a9c-f149-4c99-8a20-59382b84b1ac</uuid>
Oct 23 20:17:50 user nova-compute[74429]:   <name>instance-00000020</name>
Oct 23 20:17:50 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:17:50 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:17:50 user nova-compute[74429]:   <metadata>
Oct 23 20:17:50 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:17:50 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:17:50 user nova-compute[74429]:       <nova:name>tempest-VolumesActionsTest-instance-1541605297</nova:name>
Oct 23 20:17:50 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:17:50</nova:creationTime>
Oct 23 20:17:50 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:17:50 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:17:50 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:17:50 user nova-compute[74429]:       <nova:owner>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:user uuid="43b0353aaafb4bd684e02d8f95a98a76">tempest-VolumesActionsTest-765381540-project-member</nova:user>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:project uuid="62ae5527b83945b7a104641c9f813ffb">tempest-VolumesActionsTest-765381540</nova:project>
Oct 23 20:17:50 user nova-compute[74429]:       </nova:owner>
Oct 23 20:17:50 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:17:50 user nova-compute[74429]:       <nova:ports>
Oct 23 20:17:50 user nova-compute[74429]:         <nova:port uuid="004eb1f2-dfd8-421d-98f0-33e64b9fd045">
Oct 23 20:17:50 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 20:17:50 user nova-compute[74429]:         </nova:port>
Oct 23 20:17:50 user nova-compute[74429]:       </nova:ports>
Oct 23 20:17:50 user nova-compute[74429]:     </nova:instance>
Oct 23 20:17:50 user nova-compute[74429]:   </metadata>
Oct 23 20:17:50 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:17:50 user nova-compute[74429]:     <system>
Oct 23 20:17:50 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:17:50 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:17:50 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:17:50 user nova-compute[74429]:       <entry name="serial">59436a9c-f149-4c99-8a20-59382b84b1ac</entry>
Oct 23 20:17:50 user nova-compute[74429]:       <entry name="uuid">59436a9c-f149-4c99-8a20-59382b84b1ac</entry>
Oct 23 20:17:50 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:17:50 user nova-compute[74429]:     </system>
Oct 23 20:17:50 user nova-compute[74429]:   </sysinfo>
Oct 23 20:17:50 user nova-compute[74429]:   <os>
Oct 23 20:17:50 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:17:50 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:17:50 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:17:50 user nova-compute[74429]:   </os>
Oct 23 20:17:50 user nova-compute[74429]:   <features>
Oct 23 20:17:50 user nova-compute[74429]:     <acpi/>
Oct 23 20:17:50 user nova-compute[74429]:     <apic/>
Oct 23 20:17:50 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:17:50 user nova-compute[74429]:   </features>
Oct 23 20:17:50 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:17:50 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:17:50 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:17:50 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:17:50 user nova-compute[74429]:   </clock>
Oct 23 20:17:50 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:17:50 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:17:50 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:17:50 user nova-compute[74429]:   </cpu>
Oct 23 20:17:50 user nova-compute[74429]:   <devices>
Oct 23 20:17:50 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:17:50 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:17:50 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk"/>
Oct 23 20:17:50 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:17:50 user nova-compute[74429]:     </disk>
Oct 23 20:17:50 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:17:50 user nova-compute[74429]:       <mac address="fa:16:3e:b7:8c:f1"/>
Oct 23 20:17:50 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:50 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:17:50 user nova-compute[74429]:       <target dev="tap004eb1f2-df"/>
Oct 23 20:17:50 user nova-compute[74429]:     </interface>
Oct 23 20:17:50 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:17:50 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/console.log" append="off"/>
Oct 23 20:17:50 user nova-compute[74429]:     </serial>
Oct 23 20:17:50 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:17:50 user nova-compute[74429]:     <video>
Oct 23 20:17:50 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:50 user nova-compute[74429]:     </video>
Oct 23 20:17:50 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:17:50 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:17:50 user nova-compute[74429]:     </rng>
Oct 23 20:17:50 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:17:50 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:17:50 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:17:50 user nova-compute[74429]:     </memballoon>
Oct 23 20:17:50 user nova-compute[74429]:   </devices>
Oct 23 20:17:50 user nova-compute[74429]: </domain>
Oct 23 20:17:50 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1541605297',display_name='tempest-VolumesActionsTest-instance-1541605297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1541605297',id=32,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ae5527b83945b7a104641c9f813ffb',ramdisk_id='',reservation_id='r-qe13stij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-765381540',owner_user_name='tempest-VolumesActionsTest-765381540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:49Z,user_data=None,user_id='43b0353aaafb4bd684e02d8f95a98a76',uuid=59436a9c-f149-4c99-8a20-59382b84b1ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Converting VIF {"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG os_vif [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1777be3e-73ab-55e5-84ee-eec46584e7d5', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap004eb1f2-df, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap004eb1f2-df, col_values=(('qos', UUID('8571f671-78f9-4396-b857-d15b45d41e8c')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap004eb1f2-df, col_values=(('external_ids', {'iface-id': '004eb1f2-dfd8-421d-98f0-33e64b9fd045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:8c:f1', 'vm-uuid': '59436a9c-f149-4c99-8a20-59382b84b1ac'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:50 user nova-compute[74429]: INFO os_vif [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df')
Oct 23 20:17:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:17:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] No VIF found with MAC fa:16:3e:b7:8c:f1, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:17:51 user nova-compute[74429]: DEBUG nova.network.neutron [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Updated VIF entry in instance network info cache for port 004eb1f2-dfd8-421d-98f0-33e64b9fd045. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:17:51 user nova-compute[74429]: DEBUG nova.network.neutron [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Updating instance_info_cache with network_info: [{"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f7597052-83c8-413d-9cca-c85ea393213e req-d598cb21-315f-4040-98cf-9662921a8348 service nova] Releasing lock "refresh_cache-59436a9c-f149-4c99-8a20-59382b84b1ac" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec6e2042-e2a0-49ab-8419-50865440b11c req-76d8e9a0-c87e-4d7e-859c-71285f81c6e3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec6e2042-e2a0-49ab-8419-50865440b11c req-76d8e9a0-c87e-4d7e-859c-71285f81c6e3 service nova] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec6e2042-e2a0-49ab-8419-50865440b11c req-76d8e9a0-c87e-4d7e-859c-71285f81c6e3 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec6e2042-e2a0-49ab-8419-50865440b11c req-76d8e9a0-c87e-4d7e-859c-71285f81c6e3 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec6e2042-e2a0-49ab-8419-50865440b11c req-76d8e9a0-c87e-4d7e-859c-71285f81c6e3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] No waiting events found dispatching network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:52 user nova-compute[74429]: WARNING nova.compute.manager [req-ec6e2042-e2a0-49ab-8419-50865440b11c req-76d8e9a0-c87e-4d7e-859c-71285f81c6e3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received unexpected event network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 for instance with vm_state building and task_state spawning.
Oct 23 20:17:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:17:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Instance spawned successfully.
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-968a5be0-b661-4c97-b396-e765d509c1b6 req-f9c5cf05-50fb-4618-96fe-b5b0ec7017d2 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-968a5be0-b661-4c97-b396-e765d509c1b6 req-f9c5cf05-50fb-4618-96fe-b5b0ec7017d2 service nova] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-968a5be0-b661-4c97-b396-e765d509c1b6 req-f9c5cf05-50fb-4618-96fe-b5b0ec7017d2 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-968a5be0-b661-4c97-b396-e765d509c1b6 req-f9c5cf05-50fb-4618-96fe-b5b0ec7017d2 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-968a5be0-b661-4c97-b396-e765d509c1b6 req-f9c5cf05-50fb-4618-96fe-b5b0ec7017d2 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] No waiting events found dispatching network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:54 user nova-compute[74429]: WARNING nova.compute.manager [req-968a5be0-b661-4c97-b396-e765d509c1b6 req-f9c5cf05-50fb-4618-96fe-b5b0ec7017d2 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received unexpected event network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 for instance with vm_state building and task_state spawning.
Oct 23 20:17:54 user nova-compute[74429]: INFO nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Took 5.29 seconds to spawn the instance on the hypervisor.
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:54 user nova-compute[74429]: INFO nova.compute.manager [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Took 6.00 seconds to build instance.
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8d3554cc-640b-42fd-9512-2d461cf80c03 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.102s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:54 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:17:54 user nova-compute[74429]: INFO nova.compute.claims [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Claim successful on node user
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:17:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.policy [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '213b96dfb6b043aabcebdd6710ae8f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35bb75b1bd846e6ac415aaefd410621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:17:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Creating image(s)
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.205s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk 1073741824" returned: 0 in 0.053s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Successfully created port: 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Cannot resize image /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Ensure instance console log exists: /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Successfully updated port: 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.compute.manager [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing instance network info cache due to event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:17:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance network_info: |[{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Start _get_guest_xml network_info=[{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:17:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1649851243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1649851243',id=33,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZv/hWeiOQys3LeBOBVbZ0ndKNBVSVXYFDMAp089G2ZET/y41dwmqnHIALULYFdf1Qif34FhZLrRGDu+ZfTfpH1suUtzWOhPIB+v/VtwNm6POEPCWa3rTDKJrPQVHbRQ==',key_name='tempest-keypair-1219360172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-1hqxl9ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=c9e64e6f-6a1d-4368-8c33-bb929888a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'pci_devices' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:17:57 user nova-compute[74429]:   <uuid>c9e64e6f-6a1d-4368-8c33-bb929888a0d9</uuid>
Oct 23 20:17:57 user nova-compute[74429]:   <name>instance-00000021</name>
Oct 23 20:17:57 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:17:57 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:17:57 user nova-compute[74429]:   <metadata>
Oct 23 20:17:57 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:17:57 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:17:57 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1649851243</nova:name>
Oct 23 20:17:57 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:17:57</nova:creationTime>
Oct 23 20:17:57 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:17:57 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:17:57 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:17:57 user nova-compute[74429]:       <nova:owner>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:user uuid="213b96dfb6b043aabcebdd6710ae8f4c">tempest-AttachVolumeShelveTestJSON-301170821-project-member</nova:user>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:project uuid="e35bb75b1bd846e6ac415aaefd410621">tempest-AttachVolumeShelveTestJSON-301170821</nova:project>
Oct 23 20:17:57 user nova-compute[74429]:       </nova:owner>
Oct 23 20:17:57 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:17:57 user nova-compute[74429]:       <nova:ports>
Oct 23 20:17:57 user nova-compute[74429]:         <nova:port uuid="37f3e82c-8eab-4d8f-88be-29e6f10b3b55">
Oct 23 20:17:57 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 20:17:57 user nova-compute[74429]:         </nova:port>
Oct 23 20:17:57 user nova-compute[74429]:       </nova:ports>
Oct 23 20:17:57 user nova-compute[74429]:     </nova:instance>
Oct 23 20:17:57 user nova-compute[74429]:   </metadata>
Oct 23 20:17:57 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:17:57 user nova-compute[74429]:     <system>
Oct 23 20:17:57 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:17:57 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:17:57 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:17:57 user nova-compute[74429]:       <entry name="serial">c9e64e6f-6a1d-4368-8c33-bb929888a0d9</entry>
Oct 23 20:17:57 user nova-compute[74429]:       <entry name="uuid">c9e64e6f-6a1d-4368-8c33-bb929888a0d9</entry>
Oct 23 20:17:57 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:17:57 user nova-compute[74429]:     </system>
Oct 23 20:17:57 user nova-compute[74429]:   </sysinfo>
Oct 23 20:17:57 user nova-compute[74429]:   <os>
Oct 23 20:17:57 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:17:57 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:17:57 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:17:57 user nova-compute[74429]:   </os>
Oct 23 20:17:57 user nova-compute[74429]:   <features>
Oct 23 20:17:57 user nova-compute[74429]:     <acpi/>
Oct 23 20:17:57 user nova-compute[74429]:     <apic/>
Oct 23 20:17:57 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:17:57 user nova-compute[74429]:   </features>
Oct 23 20:17:57 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:17:57 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:17:57 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:17:57 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:17:57 user nova-compute[74429]:   </clock>
Oct 23 20:17:57 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:17:57 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:17:57 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:17:57 user nova-compute[74429]:   </cpu>
Oct 23 20:17:57 user nova-compute[74429]:   <devices>
Oct 23 20:17:57 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:17:57 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:17:57 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk"/>
Oct 23 20:17:57 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:17:57 user nova-compute[74429]:     </disk>
Oct 23 20:17:57 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:17:57 user nova-compute[74429]:       <mac address="fa:16:3e:36:93:30"/>
Oct 23 20:17:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:57 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:17:57 user nova-compute[74429]:       <target dev="tap37f3e82c-8e"/>
Oct 23 20:17:57 user nova-compute[74429]:     </interface>
Oct 23 20:17:57 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:17:57 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/console.log" append="off"/>
Oct 23 20:17:57 user nova-compute[74429]:     </serial>
Oct 23 20:17:57 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:17:57 user nova-compute[74429]:     <video>
Oct 23 20:17:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:17:57 user nova-compute[74429]:     </video>
Oct 23 20:17:57 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:17:57 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:17:57 user nova-compute[74429]:     </rng>
Oct 23 20:17:57 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:17:57 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:17:57 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:17:57 user nova-compute[74429]:     </memballoon>
Oct 23 20:17:57 user nova-compute[74429]:   </devices>
Oct 23 20:17:57 user nova-compute[74429]: </domain>
Oct 23 20:17:57 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1649851243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1649851243',id=33,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZv/hWeiOQys3LeBOBVbZ0ndKNBVSVXYFDMAp089G2ZET/y41dwmqnHIALULYFdf1Qif34FhZLrRGDu+ZfTfpH1suUtzWOhPIB+v/VtwNm6POEPCWa3rTDKJrPQVHbRQ==',key_name='tempest-keypair-1219360172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-1hqxl9ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=c9e64e6f-6a1d-4368-8c33-bb929888a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG os_vif [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef9f9e63-00bf-58b3-834b-3bd9c33c335b', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37f3e82c-8e, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37f3e82c-8e, col_values=(('qos', UUID('7185d7d9-7bbf-48fb-8e30-f0e325fe089a')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37f3e82c-8e, col_values=(('external_ids', {'iface-id': '37f3e82c-8eab-4d8f-88be-29e6f10b3b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:93:30', 'vm-uuid': 'c9e64e6f-6a1d-4368-8c33-bb929888a0d9'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:57 user nova-compute[74429]: INFO os_vif [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e')
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No VIF found with MAC fa:16:3e:36:93:30, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updated VIF entry in instance network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG nova.network.neutron [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:17:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-658f4016-53e5-41fe-8e2e-a9ecfcd35771 req-34a4bef9-4f9f-4d4c-8ccf-7e34df7ac790 service nova] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-8ea2bd04-1154-4cdd-b0ff-4cd4bc6877e2 req-85426d8b-b030-4dca-9cef-545366f96611 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8ea2bd04-1154-4cdd-b0ff-4cd4bc6877e2 req-85426d8b-b030-4dca-9cef-545366f96611 service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8ea2bd04-1154-4cdd-b0ff-4cd4bc6877e2 req-85426d8b-b030-4dca-9cef-545366f96611 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8ea2bd04-1154-4cdd-b0ff-4cd4bc6877e2 req-85426d8b-b030-4dca-9cef-545366f96611 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:17:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-8ea2bd04-1154-4cdd-b0ff-4cd4bc6877e2 req-85426d8b-b030-4dca-9cef-545366f96611 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:17:58 user nova-compute[74429]: WARNING nova.compute.manager [req-8ea2bd04-1154-4cdd-b0ff-4cd4bc6877e2 req-85426d8b-b030-4dca-9cef-545366f96611 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state building and task_state spawning.
Oct 23 20:17:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:17:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-27032bdc-58cc-46a5-be74-984cdfd03531 req-a3cd2665-1a6d-4a1a-94f4-2d1b62eb10d2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27032bdc-58cc-46a5-be74-984cdfd03531 req-a3cd2665-1a6d-4a1a-94f4-2d1b62eb10d2 service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27032bdc-58cc-46a5-be74-984cdfd03531 req-a3cd2665-1a6d-4a1a-94f4-2d1b62eb10d2 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27032bdc-58cc-46a5-be74-984cdfd03531 req-a3cd2665-1a6d-4a1a-94f4-2d1b62eb10d2 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-27032bdc-58cc-46a5-be74-984cdfd03531 req-a3cd2665-1a6d-4a1a-94f4-2d1b62eb10d2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:18:01 user nova-compute[74429]: WARNING nova.compute.manager [req-27032bdc-58cc-46a5-be74-984cdfd03531 req-a3cd2665-1a6d-4a1a-94f4-2d1b62eb10d2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state building and task_state spawning.
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:18:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance spawned successfully.
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:18:01 user nova-compute[74429]: INFO nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 23 20:18:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:18:01 user nova-compute[74429]: INFO nova.compute.manager [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Took 6.55 seconds to build instance.
Oct 23 20:18:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c9516031-d78a-4515-99b9-b66174f502a2 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.642s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Starting finish_migration {{(pid=74429) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:18:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Creating image(s)
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Ensure instance console log exists: /opt/stack/data/nova/instances/8f7a5779-cc71-45a3-8a1c-6c25ab5d2577/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Start _get_guest_xml network_info=[{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '8ebb0b34-f784-4978-a6b8-1f2ba42e87a5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8f7a5779-cc71-45a3-8a1c-6c25ab5d2577', 'attached_at': '2023-10-23T20:18:08.000000', 'detached_at': '', 'volume_id': '711bc196-6062-46c7-a013-43a3f91a8ab7', 'serial': '711bc196-6062-46c7-a013-43a3f91a8ab7'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:18:08 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:18:08 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:18:08 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:18:08 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:18:08 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae14554-6d6f-4285-8402-f5fa545215c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:18:08 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e458d0-1aba-49a7-bd22-7d4005840e4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7] added
Oct 23 20:18:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9459d0-5cbf-4535-9b4b-1c5ff7abe83d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecae8fa-02c0-4204-89dd-4f3dafcfa09b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gifmUOFY {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gifmUOFY" returned: 0 in 0.068s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe67ca-809e-46ba-b863-d68a85b3cd8f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gifmUOFY'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a218b71-0e74-4a78-9dd2-3411788f3e45]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec404bbd-9c4a-4113-9900-fbbfb24526e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:18:08 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:18:08 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:18:08 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:18:08 user nova-compute[74429]: 
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7fbb23-5ad2-48a2-b9fa-ef852e63113a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]
Oct 23 20:18:08 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.
Oct 23 20:18:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d946329-c7ab-41e5-8338-723dc45cd174]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef51f9-964e-4423-865b-8977a2cdb426]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:18:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:18:08 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a8c54-b857-4e04-bfb4-25b73dbc2fd5]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:18:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23934653939333463', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653939333463', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1052559067',display_name='tempest-ServerActionsTestOtherA-server-1052559067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1052559067',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-n54juhfi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=8f7a5779-cc71-45a3-8a1c-6c25ab5d2577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:18:09 user nova-compute[74429]:   <uuid>8f7a5779-cc71-45a3-8a1c-6c25ab5d2577</uuid>
Oct 23 20:18:09 user nova-compute[74429]:   <name>instance-0000001d</name>
Oct 23 20:18:09 user nova-compute[74429]:   <memory>2097152</memory>
Oct 23 20:18:09 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:18:09 user nova-compute[74429]:   <metadata>
Oct 23 20:18:09 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:18:09 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:18:09 user nova-compute[74429]:       <nova:name>tempest-ServerActionsTestOtherA-server-1052559067</nova:name>
Oct 23 20:18:09 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:18:08</nova:creationTime>
Oct 23 20:18:09 user nova-compute[74429]:       <nova:flavor name="m1.small">
Oct 23 20:18:09 user nova-compute[74429]:         <nova:memory>2048</nova:memory>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:disk>20</nova:disk>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:18:09 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:18:09 user nova-compute[74429]:       <nova:owner>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:user uuid="80ac3c2700c2447993ba5a8e14db0aa5">tempest-ServerActionsTestOtherA-1925715908-project-member</nova:user>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:project uuid="3f8768b24d954f5cbb03c242e6a3a1f1">tempest-ServerActionsTestOtherA-1925715908</nova:project>
Oct 23 20:18:09 user nova-compute[74429]:       </nova:owner>
Oct 23 20:18:09 user nova-compute[74429]:       <nova:ports>
Oct 23 20:18:09 user nova-compute[74429]:         <nova:port uuid="d0a97aae-567b-4f56-9860-6536c03f46c5">
Oct 23 20:18:09 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:18:09 user nova-compute[74429]:         </nova:port>
Oct 23 20:18:09 user nova-compute[74429]:       </nova:ports>
Oct 23 20:18:09 user nova-compute[74429]:     </nova:instance>
Oct 23 20:18:09 user nova-compute[74429]:   </metadata>
Oct 23 20:18:09 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:18:09 user nova-compute[74429]:     <system>
Oct 23 20:18:09 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:18:09 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:18:09 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:18:09 user nova-compute[74429]:       <entry name="serial">8f7a5779-cc71-45a3-8a1c-6c25ab5d2577</entry>
Oct 23 20:18:09 user nova-compute[74429]:       <entry name="uuid">8f7a5779-cc71-45a3-8a1c-6c25ab5d2577</entry>
Oct 23 20:18:09 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:18:09 user nova-compute[74429]:     </system>
Oct 23 20:18:09 user nova-compute[74429]:   </sysinfo>
Oct 23 20:18:09 user nova-compute[74429]:   <os>
Oct 23 20:18:09 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:18:09 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:18:09 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:18:09 user nova-compute[74429]:   </os>
Oct 23 20:18:09 user nova-compute[74429]:   <features>
Oct 23 20:18:09 user nova-compute[74429]:     <acpi/>
Oct 23 20:18:09 user nova-compute[74429]:     <apic/>
Oct 23 20:18:09 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:18:09 user nova-compute[74429]:   </features>
Oct 23 20:18:09 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:18:09 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:18:09 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:18:09 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:18:09 user nova-compute[74429]:   </clock>
Oct 23 20:18:09 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:18:09 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:18:09 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:18:09 user nova-compute[74429]:   </cpu>
Oct 23 20:18:09 user nova-compute[74429]:   <devices>
Oct 23 20:18:09 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:18:09 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:18:09 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:18:09 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:18:09 user nova-compute[74429]:       <serial>711bc196-6062-46c7-a013-43a3f91a8ab7</serial>
Oct 23 20:18:09 user nova-compute[74429]:     </disk>
Oct 23 20:18:09 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:18:09 user nova-compute[74429]:       <mac address="fa:16:3e:eb:ed:aa"/>
Oct 23 20:18:09 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:18:09 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:18:09 user nova-compute[74429]:       <target dev="tapd0a97aae-56"/>
Oct 23 20:18:09 user nova-compute[74429]:     </interface>
Oct 23 20:18:09 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:18:09 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/8f7a5779-cc71-45a3-8a1c-6c25ab5d2577/console.log" append="off"/>
Oct 23 20:18:09 user nova-compute[74429]:     </serial>
Oct 23 20:18:09 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:18:09 user nova-compute[74429]:     <video>
Oct 23 20:18:09 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:18:09 user nova-compute[74429]:     </video>
Oct 23 20:18:09 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:18:09 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:18:09 user nova-compute[74429]:     </rng>
Oct 23 20:18:09 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:18:09 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:18:09 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:18:09 user nova-compute[74429]:     </memballoon>
Oct 23 20:18:09 user nova-compute[74429]:   </devices>
Oct 23 20:18:09 user nova-compute[74429]: </domain>
Oct 23 20:18:09 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1052559067',display_name='tempest-ServerActionsTestOtherA-server-1052559067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1052559067',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-n54juhfi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=8f7a5779-cc71-45a3-8a1c-6c25ab5d2577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-443979203-network", "vif_mac": "fa:16:3e:eb:ed:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG os_vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12296500-a43a-53e2-80fc-ae58261abb6f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0a97aae-56, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0a97aae-56, col_values=(('qos', UUID('1f8eb357-933a-4410-b6ba-6c9e7c5dc852')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0a97aae-56, col_values=(('external_ids', {'iface-id': 'd0a97aae-567b-4f56-9860-6536c03f46c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:ed:aa', 'vm-uuid': '8f7a5779-cc71-45a3-8a1c-6c25ab5d2577'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:09 user nova-compute[74429]: INFO os_vif [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56')
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:18:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] No VIF found with MAC fa:16:3e:eb:ed:aa, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:18:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-d16c4709-0fbf-4cae-bfa3-30e272894d67 req-7ea27f76-7693-407a-95b1-a1aef47cff79 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d16c4709-0fbf-4cae-bfa3-30e272894d67 req-7ea27f76-7693-407a-95b1-a1aef47cff79 service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d16c4709-0fbf-4cae-bfa3-30e272894d67 req-7ea27f76-7693-407a-95b1-a1aef47cff79 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d16c4709-0fbf-4cae-bfa3-30e272894d67 req-7ea27f76-7693-407a-95b1-a1aef47cff79 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-d16c4709-0fbf-4cae-bfa3-30e272894d67 req-7ea27f76-7693-407a-95b1-a1aef47cff79 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:18:11 user nova-compute[74429]: WARNING nova.compute.manager [req-d16c4709-0fbf-4cae-bfa3-30e272894d67 req-7ea27f76-7693-407a-95b1-a1aef47cff79 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state active and task_state resize_finish.
Oct 23 20:18:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c670e5e-f982-4d06-9356-740d01a2dd8c req-8a9a6337-ddeb-4cf1-96c6-4ed7164803b2 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c670e5e-f982-4d06-9356-740d01a2dd8c req-8a9a6337-ddeb-4cf1-96c6-4ed7164803b2 service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c670e5e-f982-4d06-9356-740d01a2dd8c req-8a9a6337-ddeb-4cf1-96c6-4ed7164803b2 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c670e5e-f982-4d06-9356-740d01a2dd8c req-8a9a6337-ddeb-4cf1-96c6-4ed7164803b2 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c670e5e-f982-4d06-9356-740d01a2dd8c req-8a9a6337-ddeb-4cf1-96c6-4ed7164803b2 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:18:13 user nova-compute[74429]: WARNING nova.compute.manager [req-3c670e5e-f982-4d06-9356-740d01a2dd8c req-8a9a6337-ddeb-4cf1-96c6-4ed7164803b2 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state active and task_state resize_finish.
Oct 23 20:18:13 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance running successfully.
Oct 23 20:18:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Failed to set time: agent not configured {{(pid=74429) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6c2d39f4-3e60-4543-a63d-3e183dafecad tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] finish_migration finished successfully. {{(pid=74429) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 20:18:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:18:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:18:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:18:28 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7703MB free_disk=25.332443237304688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:18:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Applying migration context for instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 as it has an incoming, in-progress migration 7c98d3a2-97a9-4b79-bb9d-0b533c919e20. Migration status is finished {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 20:18:29 user nova-compute[74429]: INFO nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating resource usage from migration 7c98d3a2-97a9-4b79-bb9d-0b533c919e20
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 242115af-9810-43e9-8ebc-804f4d0069e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Migration 7c98d3a2-97a9-4b79-bb9d-0b533c919e20 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 59436a9c-f149-4c99-8a20-59382b84b1ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:18:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 1e185be0-50d7-4243-89a7-6c68c8707947 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [{"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-1e185be0-50d7-4243-89a7-6c68c8707947" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:18:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:18:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-changed-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:18:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Refreshing instance network info cache due to event network-changed-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:18:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] Acquiring lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:18:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] Acquired lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:18:48 user nova-compute[74429]: DEBUG nova.network.neutron [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Refreshing network info cache for port 5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:18:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updated VIF entry in instance network info cache for port 5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:18:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updating instance_info_cache with network_info: [{"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:18:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c4ca3cf3-16c4-4158-814c-c4cf0d4c7da9 req-05fdf0a7-3ecd-4fc6-b6a0-402dc2c529b8 service nova] Releasing lock "refresh_cache-242115af-9810-43e9-8ebc-804f4d0069e4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:18:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:18:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:00 user nova-compute[74429]: INFO nova.compute.manager [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attaching volume 954cab08-31c6-4243-b426-4364d0b69431 to /dev/vdb
Oct 23 20:19:00 user nova-compute[74429]: DEBUG os_brick.utils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e205c-17fa-42e0-ad4a-51e982ee1eaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2afaa0b-32ee-4aae-8fe2-226b0294dc52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[784c9452-97f1-4600-9582-3571256d12f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7417d0c-c47a-40f0-a8ff-bd0d1940c911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:19:00 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:19:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[253347a7-98fd-4ea3-9661-aff0a61bfcd5]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG os_brick.utils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:19:00 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updating existing volume attachment record: e91f4015-8ad7-460b-bf62-064d5f61348a {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:19:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing instance network info cache due to event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG nova.network.neutron [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'flavor' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG nova.network.neutron [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updated VIF entry in instance network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG nova.network.neutron [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:07 user nova-compute[74429]: INFO nova.compute.manager [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Attaching volume ee377a76-d404-4702-ad9b-029244f67140 to /dev/vdb
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e05b5959-53a0-41d8-8627-a4d7debaef67 req-cdb507c4-5f7c-460e-88d3-2eab49567744 service nova] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG os_brick.utils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b38fa-4879-47d5-97dc-82ae5b794524]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[808bb7c3-63ea-4a17-aed5-9e8f5bdea5d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c12bd-9803-41a1-b885-9d8f7855757c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a787f61-1af5-4c3b-b4cf-e04ccbcc34f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:19:08 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:19:08 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e83d7c-369a-4e46-94ae-a5d3e6b97a4e]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG os_brick.utils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating existing volume attachment record: e71816b0-b246-414d-930f-9c07d5f8e435 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:19:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcPxoyVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:19:22 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:19:22 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:19:22 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7b017-e0c6-4b06-b66d-c6d34ae3a32f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:19:22 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5025cd3-c9be-485f-96f5-11b2750243e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431] added
Oct 23 20:19:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[85675127-625f-48ec-885b-144f20a23966]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2217d-1dce-4e75-aa2c-c8c192fc8160]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcPxoyVI {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcPxoyVI" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b73f6-42fe-4c84-9aeb-f8f34b885431]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vcPxoyVI'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ba6203-9032-48b1-a127-75d5fd7e696a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[772a2a9b-334f-4e52-8d72-686f56119d77]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14aaacf-2776-4193-8890-1909423c1152]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260]
Oct 23 20:19:22 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260] successful.
Oct 23 20:19:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[32714cc1-6d4d-4521-8daa-e35f8862bf66]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7640b51c-9092-4698-97e4-b821a48d8af1]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:22 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:22 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0abe87-6083-4eba-a497-a4f522e8fb9c]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcPxoyVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23161653336316539', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653336316539', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:19:23 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:19:23 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:19:23 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:19:23 user nova-compute[74429]:   <serial>954cab08-31c6-4243-b426-4364d0b69431</serial>
Oct 23 20:19:23 user nova-compute[74429]: </disk>
Oct 23 20:19:23 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No VIF found with MAC fa:16:3e:bd:5b:1d, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e9cdf6a7-110c-439b-aff3-6b79c8578f6b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.208s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJvkVHqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:19:24 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:19:24 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:19:24 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2935a2a4-9a86-47e9-8ed9-685b6a307eb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:19:24 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc92b22-9755-4918-af7d-6a555b46ab44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140] added
Oct 23 20:19:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad873a24-f703-407e-8fbb-2679bbbf95c1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f337a66-8f17-4fc6-b5b4-ed2234e69f31]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJvkVHqb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJvkVHqb" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2717cbe-c5d6-4f2a-a8d5-77d2332d3930]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJvkVHqb'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9515630-1afb-453a-969b-814b371a83e5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d6cbb1-5065-49df-98a1-d836d24d3337]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:24 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:19:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:24 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:24 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[17981e24-d3f4-4eeb-ab08-911260b1cc71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260]
Oct 23 20:19:25 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260] successful.
Oct 23 20:19:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151af2c-ce0e-4eea-932a-42aa3f1e89b6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e60e42-5e8d-4d3b-b091-8eb3b2d87293]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:25 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:25 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:19:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:25 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:25 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:19:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d1642-e588-44a2-9ba1-628ce60f1121]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Going to confirm migration 2 {{(pid=74429) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG nova.objects.instance [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'info_cache' on Instance uuid 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJvkVHqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26462363938653330', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462363938653330', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'flavor' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:19:26 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:19:26 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:19:26 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:19:26 user nova-compute[74429]:   <serial>ee377a76-d404-4702-ad9b-029244f67140</serial>
Oct 23 20:19:26 user nova-compute[74429]: </disk>
Oct 23 20:19:26 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.objects.instance [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'migration_context' on Instance uuid 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.objects.base [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Object Instance<8f7a5779-cc71-45a3-8a1c-6c25ab5d2577> lazy-loaded attributes: info_cache,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:db:5d:9a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0c58120b-4269-4b69-9aaa-30f9250802e2 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.871s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.499s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:27 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Deleted allocation for migration 7c98d3a2-97a9-4b79-bb9d-0b533c919e20
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-017f2c98-800d-4de1-b3ef-545903e43975 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.835s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:27 user nova-compute[74429]: INFO nova.compute.manager [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Rescuing
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG nova.network.neutron [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-d9d3991b-0bfb-4a84-a102-c18b1cd26c0f req-66aaed3b-b575-41e1-9058-325337583903 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d9d3991b-0bfb-4a84-a102-c18b1cd26c0f req-66aaed3b-b575-41e1-9058-325337583903 service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d9d3991b-0bfb-4a84-a102-c18b1cd26c0f req-66aaed3b-b575-41e1-9058-325337583903 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d9d3991b-0bfb-4a84-a102-c18b1cd26c0f req-66aaed3b-b575-41e1-9058-325337583903 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-d9d3991b-0bfb-4a84-a102-c18b1cd26c0f req-66aaed3b-b575-41e1-9058-325337583903 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:29 user nova-compute[74429]: WARNING nova.compute.manager [req-d9d3991b-0bfb-4a84-a102-c18b1cd26c0f req-66aaed3b-b575-41e1-9058-325337583903 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state active and task_state rescuing.
Oct 23 20:19:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:19:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=7734MB free_disk=25.31414031982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance destroyed successfully.
Oct 23 20:19:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Attempting rescue
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74429) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance directory exists: not creating {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 20:19:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Creating image(s)
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'trusted_certs' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 242115af-9810-43e9-8ebc-804f4d0069e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 59436a9c-f149-4c99-8a20-59382b84b1ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue" returned: 0 in 0.046s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'migration_context' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.base [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<46650715-39f9-4753-a858-8f81ba2c24d5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Start _get_guest_xml network_info=[{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:db:5d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'resources' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.base [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<46650715-39f9-4753-a858-8f81ba2c24d5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'numa_topology' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.base [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<46650715-39f9-4753-a858-8f81ba2c24d5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:19:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.base [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<46650715-39f9-4753-a858-8f81ba2c24d5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1037066447',display_name='tempest-ServerRescueNegativeTestJSON-server-1037066447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1037066447',id=31,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwFn5JPNee3X1sxsdYNzK74zVoN6EDJFv00X3A9JTtBfOGcU4p/W0FbxvUwxrVuUp62R9t/tz+fskvkTmhA5LulvkXZiK+Rb4nvvNcYh8X03BNLWX+SipLJptGVIDIx0w==',key_name='tempest-keypair-1915459799',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-ld4nsqvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=46650715-39f9-4753-a858-8f81ba2c24d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:db:5d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "vif_mac": "fa:16:3e:db:5d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'pci_devices' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.objects.base [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Object Instance<46650715-39f9-4753-a858-8f81ba2c24d5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:19:29 user nova-compute[74429]:   <uuid>46650715-39f9-4753-a858-8f81ba2c24d5</uuid>
Oct 23 20:19:29 user nova-compute[74429]:   <name>instance-0000001f</name>
Oct 23 20:19:29 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:19:29 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:19:29 user nova-compute[74429]:   <metadata>
Oct 23 20:19:29 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:19:29 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:19:29 user nova-compute[74429]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1037066447</nova:name>
Oct 23 20:19:29 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:19:29</nova:creationTime>
Oct 23 20:19:29 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:19:29 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:19:29 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:19:29 user nova-compute[74429]:       <nova:owner>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:user uuid="c660b1cec6dd476aa14a3d0fb74ebd4a">tempest-ServerRescueNegativeTestJSON-1224059578-project-member</nova:user>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:project uuid="9dbb9beb49ad42fbaf6d07c88babe563">tempest-ServerRescueNegativeTestJSON-1224059578</nova:project>
Oct 23 20:19:29 user nova-compute[74429]:       </nova:owner>
Oct 23 20:19:29 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:19:29 user nova-compute[74429]:       <nova:ports>
Oct 23 20:19:29 user nova-compute[74429]:         <nova:port uuid="031e39fe-e85e-4156-8f81-9e8341ffa00c">
Oct 23 20:19:29 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 20:19:29 user nova-compute[74429]:         </nova:port>
Oct 23 20:19:29 user nova-compute[74429]:       </nova:ports>
Oct 23 20:19:29 user nova-compute[74429]:     </nova:instance>
Oct 23 20:19:29 user nova-compute[74429]:   </metadata>
Oct 23 20:19:29 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:19:29 user nova-compute[74429]:     <system>
Oct 23 20:19:29 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:19:29 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:19:29 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:19:29 user nova-compute[74429]:       <entry name="serial">46650715-39f9-4753-a858-8f81ba2c24d5</entry>
Oct 23 20:19:29 user nova-compute[74429]:       <entry name="uuid">46650715-39f9-4753-a858-8f81ba2c24d5</entry>
Oct 23 20:19:29 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:19:29 user nova-compute[74429]:     </system>
Oct 23 20:19:29 user nova-compute[74429]:   </sysinfo>
Oct 23 20:19:29 user nova-compute[74429]:   <os>
Oct 23 20:19:29 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:19:29 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:19:29 user nova-compute[74429]:   </os>
Oct 23 20:19:29 user nova-compute[74429]:   <features>
Oct 23 20:19:29 user nova-compute[74429]:     <acpi/>
Oct 23 20:19:29 user nova-compute[74429]:     <apic/>
Oct 23 20:19:29 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:19:29 user nova-compute[74429]:   </features>
Oct 23 20:19:29 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:19:29 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:19:29 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:19:29 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:19:29 user nova-compute[74429]:   </clock>
Oct 23 20:19:29 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:19:29 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:19:29 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:19:29 user nova-compute[74429]:   </cpu>
Oct 23 20:19:29 user nova-compute[74429]:   <devices>
Oct 23 20:19:29 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:19:29 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:19:29 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue"/>
Oct 23 20:19:29 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:19:29 user nova-compute[74429]:     </disk>
Oct 23 20:19:29 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:19:29 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:19:29 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk"/>
Oct 23 20:19:29 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:19:29 user nova-compute[74429]:     </disk>
Oct 23 20:19:29 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:19:29 user nova-compute[74429]:       <mac address="fa:16:3e:db:5d:9a"/>
Oct 23 20:19:29 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:19:29 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:19:29 user nova-compute[74429]:       <target dev="tap031e39fe-e8"/>
Oct 23 20:19:29 user nova-compute[74429]:     </interface>
Oct 23 20:19:29 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:19:29 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/console.log" append="off"/>
Oct 23 20:19:29 user nova-compute[74429]:     </serial>
Oct 23 20:19:29 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:19:29 user nova-compute[74429]:     <video>
Oct 23 20:19:29 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:19:29 user nova-compute[74429]:     </video>
Oct 23 20:19:29 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:19:29 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:19:29 user nova-compute[74429]:     </rng>
Oct 23 20:19:29 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:19:29 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:19:29 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:19:29 user nova-compute[74429]:     </memballoon>
Oct 23 20:19:29 user nova-compute[74429]:   </devices>
Oct 23 20:19:29 user nova-compute[74429]: </domain>
Oct 23 20:19:29 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:19:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance destroyed successfully.
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] No VIF found with MAC fa:16:3e:db:5d:9a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.objects.instance [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-63dc0972-89ec-4b62-9328-e37d9264668c req-1e8e48c1-7fe5-4373-a4a9-d105d9b22b4f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-63dc0972-89ec-4b62-9328-e37d9264668c req-1e8e48c1-7fe5-4373-a4a9-d105d9b22b4f service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-63dc0972-89ec-4b62-9328-e37d9264668c req-1e8e48c1-7fe5-4373-a4a9-d105d9b22b4f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-63dc0972-89ec-4b62-9328-e37d9264668c req-1e8e48c1-7fe5-4373-a4a9-d105d9b22b4f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-63dc0972-89ec-4b62-9328-e37d9264668c req-1e8e48c1-7fe5-4373-a4a9-d105d9b22b4f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:30 user nova-compute[74429]: WARNING nova.compute.manager [req-63dc0972-89ec-4b62-9328-e37d9264668c req-1e8e48c1-7fe5-4373-a4a9-d105d9b22b4f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state active and task_state rescuing.
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:31 user nova-compute[74429]: INFO nova.compute.manager [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attaching volume 8a1677c6-03bb-4d07-a635-5afbf9c6a142 to /dev/vdc
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG os_brick.utils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc1e16-7dba-4224-97b9-f9fc4f1c584b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b44f5-6252-469c-8c55-dbbf870967cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eceb85-9218-4ba8-8290-c1241f4e9a36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8148d4ab-f706-44c0-82b7-bcde25b08bde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:19:31 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c37c2b2-0fb8-493e-8789-8c7432747a38]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG os_brick.utils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updating existing volume attachment record: 49a6b872-870e-4a95-ba9a-70316891576e {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:19:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:32 user nova-compute[74429]: WARNING nova.compute.manager [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state active and task_state rescuing.
Oct 23 20:19:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:32 user nova-compute[74429]: WARNING nova.compute.manager [req-21d09b38-a794-4d81-8542-f5c3ede5d9f3 req-a918eb28-2048-43a2-80e5-80f505df29d5 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state active and task_state rescuing.
Oct 23 20:19:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-6afc5896-d5ec-45cd-b5d5-69d6ea10c0fd tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:19:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:19:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing instance network info cache due to event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:19:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:46 user nova-compute[74429]: DEBUG nova.network.neutron [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:19:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updated VIF entry in instance network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:19:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f74107b3-e5fd-47b7-a05a-330f5ecf576f req-b65584a5-cc49-429b-8839-1efbc5b2ac6b service nova] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:53 user nova-compute[74429]: INFO nova.compute.manager [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Shelving
Oct 23 20:19:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-56c52dc9-7380-4a6f-a555-55da06071b9d req-164007e9-5b28-43e9-80c8-a6ebad1f1ba4 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-unplugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-56c52dc9-7380-4a6f-a555-55da06071b9d req-164007e9-5b28-43e9-80c8-a6ebad1f1ba4 service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-56c52dc9-7380-4a6f-a555-55da06071b9d req-164007e9-5b28-43e9-80c8-a6ebad1f1ba4 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-56c52dc9-7380-4a6f-a555-55da06071b9d req-164007e9-5b28-43e9-80c8-a6ebad1f1ba4 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-56c52dc9-7380-4a6f-a555-55da06071b9d req-164007e9-5b28-43e9-80c8-a6ebad1f1ba4 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-unplugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:53 user nova-compute[74429]: WARNING nova.compute.manager [req-56c52dc9-7380-4a6f-a555-55da06071b9d req-164007e9-5b28-43e9-80c8-a6ebad1f1ba4 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-unplugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state active and task_state shelving.
Oct 23 20:19:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance destroyed successfully.
Oct 23 20:19:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Beginning cold snapshot process
Oct 23 20:19:54 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:19:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk /opt/stack/data/nova/instances/snapshots/tmp1jl29rlu/208edfa2c2244d63bd2e21778ce0c9cb {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk /opt/stack/data/nova/instances/snapshots/tmp1jl29rlu/208edfa2c2244d63bd2e21778ce0c9cb" returned: 0 in 0.551s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Snapshot extracted, beginning image upload
Oct 23 20:19:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-37cb120d-c4b6-4add-a7a4-b6260dff7e92 req-da0b3765-2219-4f1f-bf00-58ec78b90d1a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-37cb120d-c4b6-4add-a7a4-b6260dff7e92 req-da0b3765-2219-4f1f-bf00-58ec78b90d1a service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-37cb120d-c4b6-4add-a7a4-b6260dff7e92 req-da0b3765-2219-4f1f-bf00-58ec78b90d1a service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-37cb120d-c4b6-4add-a7a4-b6260dff7e92 req-da0b3765-2219-4f1f-bf00-58ec78b90d1a service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-37cb120d-c4b6-4add-a7a4-b6260dff7e92 req-da0b3765-2219-4f1f-bf00-58ec78b90d1a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:55 user nova-compute[74429]: WARNING nova.compute.manager [req-37cb120d-c4b6-4add-a7a4-b6260dff7e92 req-da0b3765-2219-4f1f-bf00-58ec78b90d1a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 20:19:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:56 user nova-compute[74429]: INFO nova.compute.manager [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Terminating instance
Oct 23 20:19:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-7cfb2899-99ec-478f-93bf-3a88dcc806a5 req-58bef1ff-1602-43c9-9a3f-c2195ccf6aa4 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-vif-unplugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7cfb2899-99ec-478f-93bf-3a88dcc806a5 req-58bef1ff-1602-43c9-9a3f-c2195ccf6aa4 service nova] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7cfb2899-99ec-478f-93bf-3a88dcc806a5 req-58bef1ff-1602-43c9-9a3f-c2195ccf6aa4 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7cfb2899-99ec-478f-93bf-3a88dcc806a5 req-58bef1ff-1602-43c9-9a3f-c2195ccf6aa4 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-7cfb2899-99ec-478f-93bf-3a88dcc806a5 req-58bef1ff-1602-43c9-9a3f-c2195ccf6aa4 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] No waiting events found dispatching network-vif-unplugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-7cfb2899-99ec-478f-93bf-3a88dcc806a5 req-58bef1ff-1602-43c9-9a3f-c2195ccf6aa4 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-vif-unplugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Instance destroyed successfully.
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lazy-loading 'resources' on Instance uuid 59436a9c-f149-4c99-8a20-59382b84b1ac {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1541605297',display_name='tempest-VolumesActionsTest-instance-1541605297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1541605297',id=32,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ae5527b83945b7a104641c9f813ffb',ramdisk_id='',reservation_id='r-qe13stij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-765381540',owner_user_name='tempest-VolumesActionsTest-765381540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:17:55Z,user_data=None,user_id='43b0353aaafb4bd684e02d8f95a98a76',uuid=59436a9c-f149-4c99-8a20-59382b84b1ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Converting VIF {"id": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "address": "fa:16:3e:b7:8c:f1", "network": {"id": "c8e83bed-d688-45b2-9165-28bdf426547f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-28962374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ae5527b83945b7a104641c9f813ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004eb1f2-df", "ovs_interfaceid": "004eb1f2-dfd8-421d-98f0-33e64b9fd045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG os_vif [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap004eb1f2-df, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8571f671-78f9-4396-b857-d15b45d41e8c) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:57 user nova-compute[74429]: INFO os_vif [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8c:f1,bridge_name='br-int',has_traffic_filtering=True,id=004eb1f2-dfd8-421d-98f0-33e64b9fd045,network=Network(c8e83bed-d688-45b2-9165-28bdf426547f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004eb1f2-df')
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Deleting instance files /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac_del
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Deletion of /opt/stack/data/nova/instances/59436a9c-f149-4c99-8a20-59382b84b1ac_del complete
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.compute.manager [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Took 0.77 seconds to destroy the instance on the hypervisor.
Oct 23 20:19:57 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Snapshot image upload complete
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.compute.manager [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Shelve offloading
Oct 23 20:19:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance destroyed successfully.
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:58 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Took 0.56 seconds to deallocate network for instance.
Oct 23 20:19:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:58 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Deleted allocations for instance 59436a9c-f149-4c99-8a20-59382b84b1ac
Oct 23 20:19:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-591fca94-617e-40c2-ad76-ed677086e2a5 tempest-VolumesActionsTest-765381540 tempest-VolumesActionsTest-765381540-project-member] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance destroyed successfully.
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'resources' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1649851243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1649851243',id=33,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZv/hWeiOQys3LeBOBVbZ0ndKNBVSVXYFDMAp089G2ZET/y41dwmqnHIALULYFdf1Qif34FhZLrRGDu+ZfTfpH1suUtzWOhPIB+v/VtwNm6POEPCWa3rTDKJrPQVHbRQ==',key_name='tempest-keypair-1219360172',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-1hqxl9ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member',shelved_at='2023-10-23T20:19:57.811830',shelved_host='user',shelved_image_id='74fc83c3-b179-4adf-bba6-af1e1e9f2f01'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=c9e64e6f-6a1d-4368-8c33-bb929888a0d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_vif [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37f3e82c-8e, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7185d7d9-7bbf-48fb-8e30-f0e325fe089a) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:19:59 user nova-compute[74429]: INFO os_vif [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e')
Oct 23 20:19:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Deleting instance files /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9_del
Oct 23 20:19:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Deletion of /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9_del complete
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing instance network info cache due to event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.network.neutron [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] Acquiring lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] Lock "59436a9c-f149-4c99-8a20-59382b84b1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] No waiting events found dispatching network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:19:59 user nova-compute[74429]: WARNING nova.compute.manager [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received unexpected event network-vif-plugged-004eb1f2-dfd8-421d-98f0-33e64b9fd045 for instance with vm_state deleted and task_state None.
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-cb2fe366-1699-4f85-9e7e-8ac27845cb85 req-fcc72ac7-bd7a-4ea0-8db7-b3334a74b0b3 service nova] [instance: 59436a9c-f149-4c99-8a20-59382b84b1ac] Received event network-vif-deleted-004eb1f2-dfd8-421d-98f0-33e64b9fd045 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlrPOdyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:19:59 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:19:59 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:19:59 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fcc065-d392-4a96-a593-6094a265fc7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:19:59 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b41004a-3fcd-4768-8b5e-3fdbe9c8ff92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142] added
Oct 23 20:19:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3185a4a-ec2f-48a8-80a5-af3482a191e4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Deleted allocations for instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[804ae2a6-8447-421d-9f41-cd47b754d67b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mlrPOdyQ {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mlrPOdyQ" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d9f57-0aad-4543-a17a-7f96e0d72d2b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mlrPOdyQ'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'numa_topology' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.objects.base [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<c9e64e6f-6a1d-4368-8c33-bb929888a0d9> lazy-loaded attributes: resources,numa_topology {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61d5c3-9329-4406-a24e-104362039763]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde16874-ce23-4b10-a391-b6c7f429a9bb]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead620a3-0720-45e9-929e-77d4b0d3156b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260]
Oct 23 20:19:59 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260] successful.
Oct 23 20:19:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0192bf6-4e5c-4ae1-8564-8fa76db8e093]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc135c1a-6b75-4cc8-8bca-b1753e43873b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)
Oct 23 20:19:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f6243f-883d-47cc-99ea-26f892d6bf3c]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlrPOdyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.network.neutron [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updated VIF entry in instance network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG nova.network.neutron [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-117e373f-fb90-4b3c-8a4f-00e46d6a155b req-7cf965fd-5153-4ca2-a951-fa39bfaadc8a service nova] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:19:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d29f5954-7c77-46e4-ac03-ed21933f4ab6 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.375s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:20:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23830306133623032', 'path': '/dev/sde'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:20:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830306133623032', 'path': '/dev/sde'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:20:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:20:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:20:00 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:20:00 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:20:00 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:20:00 user nova-compute[74429]:   <serial>8a1677c6-03bb-4d07-a635-5afbf9c6a142</serial>
Oct 23 20:20:00 user nova-compute[74429]: </disk>
Oct 23 20:20:00 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:20:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:20:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:20:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:20:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] No VIF found with MAC fa:16:3e:bd:5b:1d, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:20:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-aa4e103f-1345-499f-ae92-1683cf65e6d5 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.216s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:02 user nova-compute[74429]: INFO nova.compute.manager [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Detaching volume 954cab08-31c6-4243-b426-4364d0b69431
Oct 23 20:20:02 user nova-compute[74429]: INFO nova.virt.block_device [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attempting to driver detach volume 954cab08-31c6-4243-b426-4364d0b69431 from mountpoint /dev/vdb
Oct 23 20:20:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Attempting to detach device vdb from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:20:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:20:02 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:20:02 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:20:02 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:20:02 user nova-compute[74429]:   <serial>954cab08-31c6-4243-b426-4364d0b69431</serial>
Oct 23 20:20:02 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:20:02 user nova-compute[74429]: </disk>
Oct 23 20:20:02 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:20:02 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully detached device vdb from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the persistent domain config.
Oct 23 20:20:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:20:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:20:02 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:20:02 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:20:02 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:20:02 user nova-compute[74429]:   <serial>954cab08-31c6-4243-b426-4364d0b69431</serial>
Oct 23 20:20:02 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:20:02 user nova-compute[74429]: </disk>
Oct 23 20:20:02 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:20:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:20:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:09 user nova-compute[74429]: INFO nova.compute.manager [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Terminating instance
Oct 23 20:20:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-b33b4759-1bd8-4b6f-98f0-a4dd59383bf8 req-52c9822e-a247-4d12-b66c-a917d3b433a3 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-vif-unplugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b33b4759-1bd8-4b6f-98f0-a4dd59383bf8 req-52c9822e-a247-4d12-b66c-a917d3b433a3 service nova] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b33b4759-1bd8-4b6f-98f0-a4dd59383bf8 req-52c9822e-a247-4d12-b66c-a917d3b433a3 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b33b4759-1bd8-4b6f-98f0-a4dd59383bf8 req-52c9822e-a247-4d12-b66c-a917d3b433a3 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-b33b4759-1bd8-4b6f-98f0-a4dd59383bf8 req-52c9822e-a247-4d12-b66c-a917d3b433a3 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] No waiting events found dispatching network-vif-unplugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-b33b4759-1bd8-4b6f-98f0-a4dd59383bf8 req-52c9822e-a247-4d12-b66c-a917d3b433a3 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-vif-unplugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:20:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Instance destroyed successfully.
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lazy-loading 'resources' on Instance uuid bea3939d-9184-4ca5-aa4a-dba0a1be6af8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1745532892',display_name='tempest-ServersNegativeTestJSON-server-1745532892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1745532892',id=25,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:11:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7f5bd02ac3b49d8b904b56e2e89eeef',ramdisk_id='',reservation_id='r-00zjo7wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-254346405',owner_user_name='tempest-ServersNegativeTestJSON-254346405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:11:01Z,user_data=None,user_id='6161756c0a9a4f6ba7a319801ba19818',uuid=bea3939d-9184-4ca5-aa4a-dba0a1be6af8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converting VIF {"id": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "address": "fa:16:3e:24:4a:a8", "network": {"id": "a019c500-3a30-419a-995d-4cc93ccd858b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1042439247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7f5bd02ac3b49d8b904b56e2e89eeef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24baabeb-ca", "ovs_interfaceid": "24baabeb-ca1f-4c34-91e8-282d5a79f37d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG os_vif [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24baabeb-ca, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4692344-442d-49e7-8874-65d04bdbcb90) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:10 user nova-compute[74429]: INFO os_vif [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=24baabeb-ca1f-4c34-91e8-282d5a79f37d,network=Network(a019c500-3a30-419a-995d-4cc93ccd858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24baabeb-ca')
Oct 23 20:20:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Deleting instance files /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8_del
Oct 23 20:20:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Deletion of /opt/stack/data/nova/instances/bea3939d-9184-4ca5-aa4a-dba0a1be6af8_del complete
Oct 23 20:20:10 user nova-compute[74429]: INFO nova.compute.manager [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 23 20:20:10 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:20:10 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:20:11 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:20:11 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Took 0.50 seconds to deallocate network for instance.
Oct 23 20:20:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:11 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:20:11 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:20:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:11 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Deleted allocations for instance bea3939d-9184-4ca5-aa4a-dba0a1be6af8
Oct 23 20:20:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cba4e9c8-9d8b-4026-8798-1ee9681d5dc0 tempest-ServersNegativeTestJSON-254346405 tempest-ServersNegativeTestJSON-254346405-project-member] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.678s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] Acquiring lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] Lock "bea3939d-9184-4ca5-aa4a-dba0a1be6af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] No waiting events found dispatching network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:12 user nova-compute[74429]: WARNING nova.compute.manager [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received unexpected event network-vif-plugged-24baabeb-ca1f-4c34-91e8-282d5a79f37d for instance with vm_state deleted and task_state None.
Oct 23 20:20:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-c7419114-ca99-4f08-9832-f1e49c823e88 req-d404a25d-fdd6-4a76-b283-f9e71caceee4 service nova] [instance: bea3939d-9184-4ca5-aa4a-dba0a1be6af8] Received event network-vif-deleted-24baabeb-ca1f-4c34-91e8-282d5a79f37d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:22 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 242115af-9810-43e9-8ebc-804f4d0069e4 is timed out.
Oct 23 20:20:22 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully detached device vdb from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the live domain config.
Oct 23 20:20:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcPxoyVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:20:22 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aefdc8-bbb9-495b-a958-0e03de2f6b6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:20:22 user nova-compute[74429]: No targets found.
Oct 23 20:20:22 user nova-compute[74429]: iSNS:
Oct 23 20:20:22 user nova-compute[74429]: No targets found.
Oct 23 20:20:22 user nova-compute[74429]: STATIC:
Oct 23 20:20:22 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7
Oct 23 20:20:22 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:22 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:22 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142
Oct 23 20:20:22 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:22 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:22 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431
Oct 23 20:20:22 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:22 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:22 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140
Oct 23 20:20:22 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:22 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:22 user nova-compute[74429]: FIRMWARE:
Oct 23 20:20:22 user nova-compute[74429]: No targets found.
Oct 23 20:20:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:20:22 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:20:22 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[538af56a-18e6-424d-b469-22772ec13a78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e3271-ea11-472b-8ce7-7c310ec269c4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)
Oct 23 20:20:22 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c5e0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e87bbbb-f386-46cd-9a4e-94200b871ebc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[26447363-4b91-45ba-811b-6ce6fd78ada1]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab22dee2-5c0b-4eee-a99c-f1429891d9a1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36fb067-6b1f-49cb-a114-90d3ee738c98]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413e3c8-6242-4ea2-96c9-9c436f0b1c10]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:20:22 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31fe302-a343-4f95-82df-9bbf7301c669]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260]
Oct 23 20:20:23 user nova-compute[74429]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431, portal: 172.16.0.220,3260] successful.
Oct 23 20:20:23 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954cab08-31c6-4243-b426-4364d0b69431 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a1a05-b538-4750-a793-c8b888aea487]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== disconnect_volume: return (302ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:20:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-35107833-c028-4b28-90d3-6716b7f1aebc tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:24 user nova-compute[74429]: INFO nova.compute.manager [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Detaching volume 8a1677c6-03bb-4d07-a635-5afbf9c6a142
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:20:24 user nova-compute[74429]: INFO nova.virt.block_device [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Attempting to driver detach volume 8a1677c6-03bb-4d07-a635-5afbf9c6a142 from mountpoint /dev/vdc
Oct 23 20:20:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Attempting to detach device vdc from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:20:24 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:20:24 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:20:24 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:20:24 user nova-compute[74429]:   <serial>8a1677c6-03bb-4d07-a635-5afbf9c6a142</serial>
Oct 23 20:20:24 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 20:20:24 user nova-compute[74429]: </disk>
Oct 23 20:20:24 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:20:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully detached device vdc from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the persistent domain config.
Oct 23 20:20:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:20:24 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:20:24 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:20:24 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:20:24 user nova-compute[74429]:   <serial>8a1677c6-03bb-4d07-a635-5afbf9c6a142</serial>
Oct 23 20:20:24 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 20:20:24 user nova-compute[74429]: </disk>
Oct 23 20:20:24 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:20:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:20:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:20:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=25.33660888671875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 242115af-9810-43e9-8ebc-804f4d0069e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:20:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:20:28 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:20:28 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:20:28 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:20:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:20:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:20:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:20:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:20:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updating instance_info_cache with network_info: [{"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-36eb1960-5d84-4bd7-bf9b-878cfb13196f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:20:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:20:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:20:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:20:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:45 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 242115af-9810-43e9-8ebc-804f4d0069e4 is timed out.
Oct 23 20:20:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully detached device vdc from instance 242115af-9810-43e9-8ebc-804f4d0069e4 from the live domain config.
Oct 23 20:20:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlrPOdyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:20:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48cef0-f935-48c3-8e15-1a8cecc0016c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:20:45 user nova-compute[74429]: No targets found.
Oct 23 20:20:45 user nova-compute[74429]: iSNS:
Oct 23 20:20:45 user nova-compute[74429]: No targets found.
Oct 23 20:20:45 user nova-compute[74429]: STATIC:
Oct 23 20:20:45 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7
Oct 23 20:20:45 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:45 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:45 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142
Oct 23 20:20:45 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:45 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:45 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140
Oct 23 20:20:45 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:20:45 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:20:45 user nova-compute[74429]: FIRMWARE:
Oct 23 20:20:45 user nova-compute[74429]: No targets found.
Oct 23 20:20:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:20:45 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:20:45 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[836cc55a-7e8a-4959-8cbc-83ca1809c777]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fced34-c157-4492-aac9-c7412fa5a67c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:20:45 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:20:45 user nova-compute[74429]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)
Oct 23 20:20:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:20:45 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:20:45 user nova-compute[74429]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 (non-flash)
Oct 23 20:20:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5822ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142'): ({'sde'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Removing single pathed devices sde {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abae1a9-f8a4-46a6-b27f-98f0dd396e71]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f99c9-22fb-4b96-a880-4ddbc9bbd7ba]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Flushing IO for device /dev/sde {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ded9f-af41-4997-adcd-483b8b792dbc]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[989fb149-d345-4314-80fc-d56705fcf6ac]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2521d-1aa2-4f48-ad1b-9b44ec09753b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fdaba7-58b8-422e-8da9-0dea81445b4e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260]
Oct 23 20:20:45 user nova-compute[74429]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142, portal: 172.16.0.220,3260] successful.
Oct 23 20:20:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1677c6-03bb-4d07-a635-5afbf9c6a142 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa198867-9e1f-4668-b24c-1cd92e7f293d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] <== disconnect_volume: return (300ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:20:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:20:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'flavor' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:20:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b97cb7cd-90ae-4f76-ad39-21a5755b3e08 tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:20:47 user nova-compute[74429]: INFO nova.compute.claims [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Claim successful on node user
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:20:47 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:47 user nova-compute[74429]: INFO nova.compute.manager [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Terminating instance
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.policy [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a79f42a7a6344b969b6656fcb17906f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0520808b577c4d5ab4a93ad903dfce2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:20:47 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Creating image(s)
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "/opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "/opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "/opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-8f92ebee-7788-47b3-af8f-9a10d11a9d80 req-d12d846c-ae04-498e-80db-cab0f4ffa085 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-unplugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8f92ebee-7788-47b3-af8f-9a10d11a9d80 req-d12d846c-ae04-498e-80db-cab0f4ffa085 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8f92ebee-7788-47b3-af8f-9a10d11a9d80 req-d12d846c-ae04-498e-80db-cab0f4ffa085 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8f92ebee-7788-47b3-af8f-9a10d11a9d80 req-d12d846c-ae04-498e-80db-cab0f4ffa085 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-8f92ebee-7788-47b3-af8f-9a10d11a9d80 req-d12d846c-ae04-498e-80db-cab0f4ffa085 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-unplugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-8f92ebee-7788-47b3-af8f-9a10d11a9d80 req-d12d846c-ae04-498e-80db-cab0f4ffa085 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-unplugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk 1073741824" returned: 0 in 0.050s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:20:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Instance destroyed successfully.
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lazy-loading 'resources' on Instance uuid 242115af-9810-43e9-8ebc-804f4d0069e4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1879463098',display_name='tempest-AttachVolumeTestJSON-server-1879463098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1879463098',id=30,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLggpL+5VlWCaB8PztPkgNu2N9UdO+mukkrKI/+QtY2urShNXoJfy/jBJZRyyrJUCDE0KfUgpjmOpR3lPNrDAE0dpNtczQKRcpXm8ZYMOpJFgvrhABJgg2voukCcr39ORQ==',key_name='tempest-keypair-1141036858',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:17:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4121e72c37c4fa5acfd0f568fc1153d',ramdisk_id='',reservation_id='r-rty5c93c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1733625309',owner_user_name='tempest-AttachVolumeTestJSON-1733625309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce4aa1886f044d3bb7c952632b48047',uuid=242115af-9810-43e9-8ebc-804f4d0069e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converting VIF {"id": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "address": "fa:16:3e:bd:5b:1d", "network": {"id": "74e9f707-49f6-4105-92a9-e83bf038bf92", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1257281268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4121e72c37c4fa5acfd0f568fc1153d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4a431d-fd", "ovs_interfaceid": "5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG os_vif [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f4a431d-fd, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b73951e-e9a7-4398-92cc-cdecf8aaa5f1) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: INFO os_vif [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:5b:1d,bridge_name='br-int',has_traffic_filtering=True,id=5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf,network=Network(74e9f707-49f6-4105-92a9-e83bf038bf92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4a431d-fd')
Oct 23 20:20:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Deleting instance files /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4_del
Oct 23 20:20:48 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Deletion of /opt/stack/data/nova/instances/242115af-9810-43e9-8ebc-804f4d0069e4_del complete
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.network.neutron [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Successfully created port: 3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:20:48 user nova-compute[74429]: INFO nova.compute.manager [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Cannot resize image /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Ensure instance console log exists: /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Successfully updated port: 3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquired lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-changed-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Refreshing instance network info cache due to event network-changed-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] Acquiring lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating instance_info_cache with network_info: [{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Releasing lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Instance network_info: |[{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] Acquired lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Refreshing network info cache for port 3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Start _get_guest_xml network_info=[{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-726237298',display_name='tempest-SnapshotDataIntegrityTests-server-726237298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-726237298',id=34,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qHYulHsAPrw9za7o0l8P3WKT/KyPi12shDygZpbtGj06UvfzujNylV9pwLpT1HHGqHRfoL9e7Vy5DAEH9DYzIouLkU7jaX4JD2kNgWy98c7bUJc3N6CwtxXCuUKYg4A==',key_name='tempest-keypair-44181116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0520808b577c4d5ab4a93ad903dfce2f',ramdisk_id='',reservation_id='r-1ohh4qcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1581079693',owner_user_name='tempest-SnapshotDataIntegrityTests-1581079693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a79f42a7a6344b969b6656fcb17906f6',uuid=81531119-0cca-4cf3-9cfc-113587c2c786,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Converting VIF {"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.objects.instance [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'pci_devices' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:20:49 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Took 1.07 seconds to deallocate network for instance.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:20:49 user nova-compute[74429]:   <uuid>81531119-0cca-4cf3-9cfc-113587c2c786</uuid>
Oct 23 20:20:49 user nova-compute[74429]:   <name>instance-00000022</name>
Oct 23 20:20:49 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:20:49 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:20:49 user nova-compute[74429]:   <metadata>
Oct 23 20:20:49 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:20:49 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:20:49 user nova-compute[74429]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-726237298</nova:name>
Oct 23 20:20:49 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:20:49</nova:creationTime>
Oct 23 20:20:49 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:20:49 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:20:49 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:20:49 user nova-compute[74429]:       <nova:owner>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:user uuid="a79f42a7a6344b969b6656fcb17906f6">tempest-SnapshotDataIntegrityTests-1581079693-project-member</nova:user>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:project uuid="0520808b577c4d5ab4a93ad903dfce2f">tempest-SnapshotDataIntegrityTests-1581079693</nova:project>
Oct 23 20:20:49 user nova-compute[74429]:       </nova:owner>
Oct 23 20:20:49 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:20:49 user nova-compute[74429]:       <nova:ports>
Oct 23 20:20:49 user nova-compute[74429]:         <nova:port uuid="3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6">
Oct 23 20:20:49 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:20:49 user nova-compute[74429]:         </nova:port>
Oct 23 20:20:49 user nova-compute[74429]:       </nova:ports>
Oct 23 20:20:49 user nova-compute[74429]:     </nova:instance>
Oct 23 20:20:49 user nova-compute[74429]:   </metadata>
Oct 23 20:20:49 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:20:49 user nova-compute[74429]:     <system>
Oct 23 20:20:49 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:20:49 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:20:49 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:20:49 user nova-compute[74429]:       <entry name="serial">81531119-0cca-4cf3-9cfc-113587c2c786</entry>
Oct 23 20:20:49 user nova-compute[74429]:       <entry name="uuid">81531119-0cca-4cf3-9cfc-113587c2c786</entry>
Oct 23 20:20:49 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:20:49 user nova-compute[74429]:     </system>
Oct 23 20:20:49 user nova-compute[74429]:   </sysinfo>
Oct 23 20:20:49 user nova-compute[74429]:   <os>
Oct 23 20:20:49 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:20:49 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:20:49 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:20:49 user nova-compute[74429]:   </os>
Oct 23 20:20:49 user nova-compute[74429]:   <features>
Oct 23 20:20:49 user nova-compute[74429]:     <acpi/>
Oct 23 20:20:49 user nova-compute[74429]:     <apic/>
Oct 23 20:20:49 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:20:49 user nova-compute[74429]:   </features>
Oct 23 20:20:49 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:20:49 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:20:49 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:20:49 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:20:49 user nova-compute[74429]:   </clock>
Oct 23 20:20:49 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:20:49 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:20:49 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:20:49 user nova-compute[74429]:   </cpu>
Oct 23 20:20:49 user nova-compute[74429]:   <devices>
Oct 23 20:20:49 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:20:49 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:20:49 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk"/>
Oct 23 20:20:49 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:20:49 user nova-compute[74429]:     </disk>
Oct 23 20:20:49 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:20:49 user nova-compute[74429]:       <mac address="fa:16:3e:3d:22:97"/>
Oct 23 20:20:49 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:20:49 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:20:49 user nova-compute[74429]:       <target dev="tap3468ca7c-1e"/>
Oct 23 20:20:49 user nova-compute[74429]:     </interface>
Oct 23 20:20:49 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:20:49 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/console.log" append="off"/>
Oct 23 20:20:49 user nova-compute[74429]:     </serial>
Oct 23 20:20:49 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:20:49 user nova-compute[74429]:     <video>
Oct 23 20:20:49 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:20:49 user nova-compute[74429]:     </video>
Oct 23 20:20:49 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:20:49 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:20:49 user nova-compute[74429]:     </rng>
Oct 23 20:20:49 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:20:49 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:20:49 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:20:49 user nova-compute[74429]:     </memballoon>
Oct 23 20:20:49 user nova-compute[74429]:   </devices>
Oct 23 20:20:49 user nova-compute[74429]: </domain>
Oct 23 20:20:49 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-726237298',display_name='tempest-SnapshotDataIntegrityTests-server-726237298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-726237298',id=34,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qHYulHsAPrw9za7o0l8P3WKT/KyPi12shDygZpbtGj06UvfzujNylV9pwLpT1HHGqHRfoL9e7Vy5DAEH9DYzIouLkU7jaX4JD2kNgWy98c7bUJc3N6CwtxXCuUKYg4A==',key_name='tempest-keypair-44181116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0520808b577c4d5ab4a93ad903dfce2f',ramdisk_id='',reservation_id='r-1ohh4qcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1581079693',owner_user_name='tempest-SnapshotDataIntegrityTests-1581079693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a79f42a7a6344b969b6656fcb17906f6',uuid=81531119-0cca-4cf3-9cfc-113587c2c786,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Converting VIF {"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG os_vif [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e97728e-f996-580f-86df-0f3618a48124', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3468ca7c-1e, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3468ca7c-1e, col_values=(('qos', UUID('5507b165-8826-45a7-8c1a-ee7240552a40')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3468ca7c-1e, col_values=(('external_ids', {'iface-id': '3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:22:97', 'vm-uuid': '81531119-0cca-4cf3-9cfc-113587c2c786'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:49 user nova-compute[74429]: INFO os_vif [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e')
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No VIF found with MAC fa:16:3e:3d:22:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state deleted and task_state None.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state deleted and task_state None.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state deleted and task_state None.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-unplugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-unplugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-unplugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state deleted and task_state None.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Acquiring lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] Lock "242115af-9810-43e9-8ebc-804f4d0069e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] No waiting events found dispatching network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:49 user nova-compute[74429]: WARNING nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received unexpected event network-vif-plugged-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf for instance with vm_state deleted and task_state None.
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-5b659942-1368-42e4-a3ad-69a1fa0a6e11 req-b1a9c4a0-de0a-4bf4-acb8-f3eb5ea25f14 service nova] [instance: 242115af-9810-43e9-8ebc-804f4d0069e4] Received event network-vif-deleted-5f4a431d-fd3c-4ef8-8644-cc5d1835fcbf {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updated VIF entry in instance network info cache for port 3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating instance_info_cache with network_info: [{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b2281b6b-492e-4cb9-aef7-a25336241150 req-2db0f98c-fe83-4d92-9d3f-73ef6d644429 service nova] Releasing lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:20:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:49 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Deleted allocations for instance 242115af-9810-43e9-8ebc-804f4d0069e4
Oct 23 20:20:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f33e4c75-757d-4876-82bd-60f3a3cd7e3b tempest-AttachVolumeTestJSON-1733625309 tempest-AttachVolumeTestJSON-1733625309-project-member] Lock "242115af-9810-43e9-8ebc-804f4d0069e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] No waiting events found dispatching network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:51 user nova-compute[74429]: WARNING nova.compute.manager [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received unexpected event network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 for instance with vm_state building and task_state spawning.
Oct 23 20:20:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] No waiting events found dispatching network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:20:51 user nova-compute[74429]: WARNING nova.compute.manager [req-da63c8ce-d4d4-435c-bbb0-f04f2bbeedd2 req-342e1ee5-8311-4e1c-b1de-28bf0737cb37 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received unexpected event network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 for instance with vm_state building and task_state spawning.
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:20:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Instance spawned successfully.
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:20:53 user nova-compute[74429]: INFO nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Took 5.54 seconds to spawn the instance on the hypervisor.
Oct 23 20:20:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:20:53 user nova-compute[74429]: INFO nova.compute.manager [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Took 6.21 seconds to build instance.
Oct 23 20:20:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-81a15357-5acf-4c89-b4cd-4c04f3ce0543 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.447s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:20:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:20:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:16 user nova-compute[74429]: INFO nova.compute.manager [None req-597ce683-6b2d-4db0-b529-f82292086bb4 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Get console output
Oct 23 20:21:16 user nova-compute[74429]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 23 20:21:18 user nova-compute[74429]: INFO nova.compute.manager [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Unrescuing
Oct 23 20:21:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:21:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:21:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:21:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG nova.objects.instance [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'flavor' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-d30528d1-d587-4d65-a37c-4c23b33d030a req-5d5b4c61-546b-4e12-97ed-a8347afdaf5a service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d30528d1-d587-4d65-a37c-4c23b33d030a req-5d5b4c61-546b-4e12-97ed-a8347afdaf5a service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d30528d1-d587-4d65-a37c-4c23b33d030a req-5d5b4c61-546b-4e12-97ed-a8347afdaf5a service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d30528d1-d587-4d65-a37c-4c23b33d030a req-5d5b4c61-546b-4e12-97ed-a8347afdaf5a service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-d30528d1-d587-4d65-a37c-4c23b33d030a req-5d5b4c61-546b-4e12-97ed-a8347afdaf5a service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:21:19 user nova-compute[74429]: WARNING nova.compute.manager [req-d30528d1-d587-4d65-a37c-4c23b33d030a req-5d5b4c61-546b-4e12-97ed-a8347afdaf5a service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:19 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance destroyed successfully.
Oct 23 20:21:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:21:21 user nova-compute[74429]: WARNING nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:21:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:21:21 user nova-compute[74429]: WARNING nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:21:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:21 user nova-compute[74429]: DEBUG nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:21:21 user nova-compute[74429]: WARNING nova.compute.manager [req-93f7acf9-59ce-4168-bf97-db7da7ced2a3 req-953f906a-7d6e-414b-9bb5-d434e332961f service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state rescued and task_state unrescuing.
Oct 23 20:21:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-08e2fbb7-c4c0-42d6-a18a-11ddaa2d738d tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:21:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:21:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:21:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:21:29 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8164MB free_disk=25.32379913330078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:21:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:21:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:21:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [{"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:21:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:21:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:46 user nova-compute[74429]: INFO nova.compute.manager [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Unshelving
Oct 23 20:21:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'pci_requests' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'numa_topology' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:21:46 user nova-compute[74429]: INFO nova.compute.claims [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Claim successful on node user
Oct 23 20:21:46 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:21:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:46 user nova-compute[74429]: INFO nova.network.neutron [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing instance network info cache due to event network-changed-37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:21:47 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Creating image(s)
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.objects.instance [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Refreshing network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG nova.objects.base [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<c9e64e6f-6a1d-4368-8c33-bb929888a0d9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "3182dc1202697089ddb2116c35d88ba414b2949d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "3182dc1202697089ddb2116c35d88ba414b2949d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG nova.virt.images [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] 74fc83c3-b179-4adf-bba6-af1e1e9f2f01 was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.part /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updated VIF entry in instance network info cache for port 37f3e82c-8eab-4d8f-88be-29e6f10b3b55. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-92a9c23a-6a6c-4e51-b190-acadecae1a53 req-6a3b5a27-7e00-43f5-872c-a24cb5a4c9f2 service nova] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.part /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.converted" returned: 0 in 0.265s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "3182dc1202697089ddb2116c35d88ba414b2949d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.868s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "3182dc1202697089ddb2116c35d88ba414b2949d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "3182dc1202697089ddb2116c35d88ba414b2949d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d,backing_fmt=raw /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d,backing_fmt=raw /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk 1073741824" returned: 0 in 0.049s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "3182dc1202697089ddb2116c35d88ba414b2949d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG nova.objects.instance [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'migration_context' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG nova.objects.base [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<c9e64e6f-6a1d-4368-8c33-bb929888a0d9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:21:50 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Rebasing disk image.
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d -F raw /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d -F raw /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk" returned: 0 in 2.633s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Ensure instance console log exists: /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Start _get_guest_xml network_info=[{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='385182c6b9ceabf49794f97624c43b6e',container_format='bare',created_at=2023-10-23T20:19:53Z,direct_url=<?>,disk_format='qcow2',id=74fc83c3-b179-4adf-bba6-af1e1e9f2f01,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1649851243-shelved',owner='e35bb75b1bd846e6ac415aaefd410621',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T20:19:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:21:53 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:21:53 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='385182c6b9ceabf49794f97624c43b6e',container_format='bare',created_at=2023-10-23T20:19:53Z,direct_url=<?>,disk_format='qcow2',id=74fc83c3-b179-4adf-bba6-af1e1e9f2f01,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1649851243-shelved',owner='e35bb75b1bd846e6ac415aaefd410621',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T20:19:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.objects.base [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<c9e64e6f-6a1d-4368-8c33-bb929888a0d9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1649851243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1649851243',id=33,image_ref='74fc83c3-b179-4adf-bba6-af1e1e9f2f01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1219360172',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-1hqxl9ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member',shelved_at='2023-10-23T20:19:57.811830',shelved_host='user',shelved_image_id='74fc83c3-b179-4adf-bba6-af1e1e9f2f01'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=c9e64e6f-6a1d-4368-8c33-bb929888a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'pci_devices' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.objects.base [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Object Instance<c9e64e6f-6a1d-4368-8c33-bb929888a0d9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:21:53 user nova-compute[74429]:   <uuid>c9e64e6f-6a1d-4368-8c33-bb929888a0d9</uuid>
Oct 23 20:21:53 user nova-compute[74429]:   <name>instance-00000021</name>
Oct 23 20:21:53 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:21:53 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:21:53 user nova-compute[74429]:   <metadata>
Oct 23 20:21:53 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:21:53 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:21:53 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1649851243</nova:name>
Oct 23 20:21:53 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:21:53</nova:creationTime>
Oct 23 20:21:53 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:21:53 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:21:53 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:21:53 user nova-compute[74429]:       <nova:owner>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:user uuid="213b96dfb6b043aabcebdd6710ae8f4c">tempest-AttachVolumeShelveTestJSON-301170821-project-member</nova:user>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:project uuid="e35bb75b1bd846e6ac415aaefd410621">tempest-AttachVolumeShelveTestJSON-301170821</nova:project>
Oct 23 20:21:53 user nova-compute[74429]:       </nova:owner>
Oct 23 20:21:53 user nova-compute[74429]:       <nova:root type="image" uuid="74fc83c3-b179-4adf-bba6-af1e1e9f2f01"/>
Oct 23 20:21:53 user nova-compute[74429]:       <nova:ports>
Oct 23 20:21:53 user nova-compute[74429]:         <nova:port uuid="37f3e82c-8eab-4d8f-88be-29e6f10b3b55">
Oct 23 20:21:53 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 20:21:53 user nova-compute[74429]:         </nova:port>
Oct 23 20:21:53 user nova-compute[74429]:       </nova:ports>
Oct 23 20:21:53 user nova-compute[74429]:     </nova:instance>
Oct 23 20:21:53 user nova-compute[74429]:   </metadata>
Oct 23 20:21:53 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:21:53 user nova-compute[74429]:     <system>
Oct 23 20:21:53 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:21:53 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:21:53 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:21:53 user nova-compute[74429]:       <entry name="serial">c9e64e6f-6a1d-4368-8c33-bb929888a0d9</entry>
Oct 23 20:21:53 user nova-compute[74429]:       <entry name="uuid">c9e64e6f-6a1d-4368-8c33-bb929888a0d9</entry>
Oct 23 20:21:53 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:21:53 user nova-compute[74429]:     </system>
Oct 23 20:21:53 user nova-compute[74429]:   </sysinfo>
Oct 23 20:21:53 user nova-compute[74429]:   <os>
Oct 23 20:21:53 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:21:53 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:21:53 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:21:53 user nova-compute[74429]:   </os>
Oct 23 20:21:53 user nova-compute[74429]:   <features>
Oct 23 20:21:53 user nova-compute[74429]:     <acpi/>
Oct 23 20:21:53 user nova-compute[74429]:     <apic/>
Oct 23 20:21:53 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:21:53 user nova-compute[74429]:   </features>
Oct 23 20:21:53 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:21:53 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:21:53 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:21:53 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:21:53 user nova-compute[74429]:   </clock>
Oct 23 20:21:53 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:21:53 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:21:53 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:21:53 user nova-compute[74429]:   </cpu>
Oct 23 20:21:53 user nova-compute[74429]:   <devices>
Oct 23 20:21:53 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:21:53 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:21:53 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk"/>
Oct 23 20:21:53 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:21:53 user nova-compute[74429]:     </disk>
Oct 23 20:21:53 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:21:53 user nova-compute[74429]:       <mac address="fa:16:3e:36:93:30"/>
Oct 23 20:21:53 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:21:53 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:21:53 user nova-compute[74429]:       <target dev="tap37f3e82c-8e"/>
Oct 23 20:21:53 user nova-compute[74429]:     </interface>
Oct 23 20:21:53 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:21:53 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/console.log" append="off"/>
Oct 23 20:21:53 user nova-compute[74429]:     </serial>
Oct 23 20:21:53 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:21:53 user nova-compute[74429]:     <video>
Oct 23 20:21:53 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:21:53 user nova-compute[74429]:     </video>
Oct 23 20:21:53 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:21:53 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:21:53 user nova-compute[74429]:     </rng>
Oct 23 20:21:53 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:21:53 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:21:53 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:21:53 user nova-compute[74429]:     </memballoon>
Oct 23 20:21:53 user nova-compute[74429]:   </devices>
Oct 23 20:21:53 user nova-compute[74429]: </domain>
Oct 23 20:21:53 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1649851243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1649851243',id=33,image_ref='74fc83c3-b179-4adf-bba6-af1e1e9f2f01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1219360172',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-1hqxl9ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member',shelved_at='2023-10-23T20:19:57.811830',shelved_host='user',shelved_image_id='74fc83c3-b179-4adf-bba6-af1e1e9f2f01'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=c9e64e6f-6a1d-4368-8c33-bb929888a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG os_vif [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef9f9e63-00bf-58b3-834b-3bd9c33c335b', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37f3e82c-8e, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37f3e82c-8e, col_values=(('qos', UUID('e401b97c-aab2-4250-bce4-8dfdaf30a483')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37f3e82c-8e, col_values=(('external_ids', {'iface-id': '37f3e82c-8eab-4d8f-88be-29e6f10b3b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:93:30', 'vm-uuid': 'c9e64e6f-6a1d-4368-8c33-bb929888a0d9'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:53 user nova-compute[74429]: INFO os_vif [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e')
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] No VIF found with MAC fa:16:3e:36:93:30, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:21:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-eb810b5d-e6bb-4fef-9004-1725507e4d7a req-ede263bb-fbac-403a-930b-feb627762b41 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-eb810b5d-e6bb-4fef-9004-1725507e4d7a req-ede263bb-fbac-403a-930b-feb627762b41 service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-eb810b5d-e6bb-4fef-9004-1725507e4d7a req-ede263bb-fbac-403a-930b-feb627762b41 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-eb810b5d-e6bb-4fef-9004-1725507e4d7a req-ede263bb-fbac-403a-930b-feb627762b41 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-eb810b5d-e6bb-4fef-9004-1725507e4d7a req-ede263bb-fbac-403a-930b-feb627762b41 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:21:55 user nova-compute[74429]: WARNING nova.compute.manager [req-eb810b5d-e6bb-4fef-9004-1725507e4d7a req-ede263bb-fbac-403a-930b-feb627762b41 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 20:21:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:21:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance spawned successfully.
Oct 23 20:21:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a003592-efa3-43cf-a162-29408a4aa85d req-4bdd1b12-c6df-48de-a797-46b60c33e16e service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a003592-efa3-43cf-a162-29408a4aa85d req-4bdd1b12-c6df-48de-a797-46b60c33e16e service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a003592-efa3-43cf-a162-29408a4aa85d req-4bdd1b12-c6df-48de-a797-46b60c33e16e service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a003592-efa3-43cf-a162-29408a4aa85d req-4bdd1b12-c6df-48de-a797-46b60c33e16e service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a003592-efa3-43cf-a162-29408a4aa85d req-4bdd1b12-c6df-48de-a797-46b60c33e16e service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:21:57 user nova-compute[74429]: WARNING nova.compute.manager [req-2a003592-efa3-43cf-a162-29408a4aa85d req-4bdd1b12-c6df-48de-a797-46b60c33e16e service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 20:21:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:21:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-42835781-8107-4dff-b497-93abf817d3fa tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.190s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:21:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:21:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:17 user nova-compute[74429]: INFO nova.compute.manager [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Terminating instance
Oct 23 20:22:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-1b58114d-5391-4288-a6e9-9daa6249c4c7 req-66b77ecd-6a04-447a-af8e-ba464cf47640 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-unplugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1b58114d-5391-4288-a6e9-9daa6249c4c7 req-66b77ecd-6a04-447a-af8e-ba464cf47640 service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1b58114d-5391-4288-a6e9-9daa6249c4c7 req-66b77ecd-6a04-447a-af8e-ba464cf47640 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1b58114d-5391-4288-a6e9-9daa6249c4c7 req-66b77ecd-6a04-447a-af8e-ba464cf47640 service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-1b58114d-5391-4288-a6e9-9daa6249c4c7 req-66b77ecd-6a04-447a-af8e-ba464cf47640 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-unplugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-1b58114d-5391-4288-a6e9-9daa6249c4c7 req-66b77ecd-6a04-447a-af8e-ba464cf47640 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-unplugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Instance destroyed successfully.
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'resources' on Instance uuid 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1052559067',display_name='tempest-ServerActionsTestOtherA-server-1052559067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1052559067',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-n54juhfi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=8f7a5779-cc71-45a3-8a1c-6c25ab5d2577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "d0a97aae-567b-4f56-9860-6536c03f46c5", "address": "fa:16:3e:eb:ed:aa", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a97aae-56", "ovs_interfaceid": "d0a97aae-567b-4f56-9860-6536c03f46c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_vif [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0a97aae-56, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f8eb357-933a-4410-b6ba-6c9e7c5dc852) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:18 user nova-compute[74429]: INFO os_vif [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=d0a97aae-567b-4f56-9860-6536c03f46c5,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a97aae-56')
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gifmUOFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:22:18 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6278bd65-820f-4dd6-8625-9af588d606af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:22:18 user nova-compute[74429]: No targets found.
Oct 23 20:22:18 user nova-compute[74429]: iSNS:
Oct 23 20:22:18 user nova-compute[74429]: No targets found.
Oct 23 20:22:18 user nova-compute[74429]: STATIC:
Oct 23 20:22:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7
Oct 23 20:22:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:22:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:22:18 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140
Oct 23 20:22:18 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:22:18 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:22:18 user nova-compute[74429]: FIRMWARE:
Oct 23 20:22:18 user nova-compute[74429]: No targets found.
Oct 23 20:22:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:22:18 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:22:18 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd25a9-9af1-4fd3-b19e-92f33ead7a60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b428f-dee5-4da1-aabf-a2ff188398f3]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:22:18 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:22:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 (non-flash)
Oct 23 20:22:18 user nova-compute[74429]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:22:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c5c08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3407c44a-5157-4094-9ffc-486bd9102fcd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b240b6-3bf9-4310-be25-96dc5919f192]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c15218-7564-496a-91ee-a067f0e3c2c1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5857c50f-e9c7-43a6-8123-79d4427e0d45]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e42fb06-bd3e-4b56-b8cf-949964624152]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[963dffbe-62f4-4af8-8c5e-6e314542903d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260]
Oct 23 20:22:18 user nova-compute[74429]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7, portal: 172.16.0.220,3260] successful.
Oct 23 20:22:18 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711bc196-6062-46c7-a013-43a3f91a8ab7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a4db55-60fe-4738-ad3c-8c7ff0b2ad9b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] <== disconnect_volume: return (314ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:22:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Deleting instance files /opt/stack/data/nova/instances/8f7a5779-cc71-45a3-8a1c-6c25ab5d2577_del
Oct 23 20:22:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Deletion of /opt/stack/data/nova/instances/8f7a5779-cc71-45a3-8a1c-6c25ab5d2577_del complete
Oct 23 20:22:18 user nova-compute[74429]: INFO nova.compute.manager [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 23 20:22:18 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:22:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:22:19 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Took 0.67 seconds to deallocate network for instance.
Oct 23 20:22:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-f4405ba4-e532-405e-b579-88bca0f965d8 req-e6d0465a-7969-4138-b664-d7614efc5b66 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-deleted-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:22:19 user nova-compute[74429]: INFO nova.compute.manager [req-f4405ba4-e532-405e-b579-88bca0f965d8 req-e6d0465a-7969-4138-b664-d7614efc5b66 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Neutron deleted interface d0a97aae-567b-4f56-9860-6536c03f46c5; detaching it from the instance and deleting it from the info cache
Oct 23 20:22:19 user nova-compute[74429]: DEBUG nova.network.neutron [req-f4405ba4-e532-405e-b579-88bca0f965d8 req-e6d0465a-7969-4138-b664-d7614efc5b66 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-f4405ba4-e532-405e-b579-88bca0f965d8 req-e6d0465a-7969-4138-b664-d7614efc5b66 service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Detach interface failed, port_id=d0a97aae-567b-4f56-9860-6536c03f46c5, reason: Instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-0c19de2d-f72e-4584-bbe4-5b3cb0ea2748 req-fd1c958d-1be6-413e-8266-57f7a06147ca service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0c19de2d-f72e-4584-bbe4-5b3cb0ea2748 req-fd1c958d-1be6-413e-8266-57f7a06147ca service nova] Acquiring lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0c19de2d-f72e-4584-bbe4-5b3cb0ea2748 req-fd1c958d-1be6-413e-8266-57f7a06147ca service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0c19de2d-f72e-4584-bbe4-5b3cb0ea2748 req-fd1c958d-1be6-413e-8266-57f7a06147ca service nova] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-0c19de2d-f72e-4584-bbe4-5b3cb0ea2748 req-fd1c958d-1be6-413e-8266-57f7a06147ca service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] No waiting events found dispatching network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:22:19 user nova-compute[74429]: WARNING nova.compute.manager [req-0c19de2d-f72e-4584-bbe4-5b3cb0ea2748 req-fd1c958d-1be6-413e-8266-57f7a06147ca service nova] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Received unexpected event network-vif-plugged-d0a97aae-567b-4f56-9860-6536c03f46c5 for instance with vm_state active and task_state deleting.
Oct 23 20:22:20 user nova-compute[74429]: INFO nova.compute.manager [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Took 0.85 seconds to detach 1 volumes for instance.
Oct 23 20:22:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577] Deleting volume: 711bc196-6062-46c7-a013-43a3f91a8ab7 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 20:22:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:20 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:22:20 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:22:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:20 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Deleted allocations for instance 8f7a5779-cc71-45a3-8a1c-6c25ab5d2577
Oct 23 20:22:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc216837-9bcb-4942-b169-01402450a6fa tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "8f7a5779-cc71-45a3-8a1c-6c25ab5d2577" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:22:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:22:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:22:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.28481674194336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1e185be0-50d7-4243-89a7-6c68c8707947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:22:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-changed-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Refreshing instance network info cache due to event network-changed-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] Acquiring lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] Acquired lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG nova.network.neutron [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Refreshing network info cache for port 3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:22:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:39 user nova-compute[74429]: DEBUG nova.network.neutron [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updated VIF entry in instance network info cache for port 3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:22:39 user nova-compute[74429]: DEBUG nova.network.neutron [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating instance_info_cache with network_info: [{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:22:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b89f3707-85ad-494d-ad8f-96dacf40634d req-29a69094-c2f2-4acb-9f65-cb188daa1595 service nova] Releasing lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:22:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:22:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:22:45 user nova-compute[74429]: INFO nova.compute.manager [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attaching volume 3dabcd3d-805e-435b-a5bc-8b3b05e73c9b to /dev/vdb
Oct 23 20:22:45 user nova-compute[74429]: DEBUG os_brick.utils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[39140480-c375-4599-87f4-76fe982b4152]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf576246-de7c-4245-bd5a-e53afc30a869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53f841e-26a3-491e-bb49-b09808927bcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bea06c-ad17-4936-a461-dde6032d4f56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:22:45 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:22:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fa1176-9b74-4b78-ab37-7a21f326bfef]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG os_brick.utils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:22:45 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating existing volume attachment record: cd24a4bd-65e7-4a81-82a5-03fe3b95d36f {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:22:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:22:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTqGtaJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:23:02 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:23:02 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:23:02 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4eff4-ec4a-49a7-8d77-0a51c6d83f8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:23:02 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[12daa0f9-7643-4099-82dc-2c62ec8d4dd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b] added
Oct 23 20:23:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c112c-8d5c-489a-a719-83974f8e613a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee6203-319c-440e-ba2f-e4cbed6840e5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTqGtaJB {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTqGtaJB" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f099dc-398a-4187-a371-2924c282b86b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LTqGtaJB'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f8022-4dba-4736-94aa-9ee33d675281]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5f426-51ad-41bc-88a9-5662000b35b9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:23:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:23:02 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:23:02 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[34231755-9079-42a3-b74f-92e751f4964e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260]
Oct 23 20:23:03 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260] successful.
Oct 23 20:23:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df3495-ac86-4f5c-860f-260f3f3853f5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eef4fe-534e-4dc3-b7be-2c224af0e0fd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:23:03 user nova-compute[74429]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)
Oct 23 20:23:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:23:03 user nova-compute[74429]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)
Oct 23 20:23:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f6a70d-8fae-4c24-b524-d578f850c3ca]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTqGtaJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26361316662623634', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361316662623634', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:23:04 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:23:04 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:23:04 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:23:04 user nova-compute[74429]:   <serial>3dabcd3d-805e-435b-a5bc-8b3b05e73c9b</serial>
Oct 23 20:23:04 user nova-compute[74429]: </disk>
Oct 23 20:23:04 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No VIF found with MAC fa:16:3e:3d:22:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:23:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e1612580-4305-461c-a921-1c4d188c9fd9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.192s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "e213a14b-bed9-4bab-9545-d032140adab7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:23:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:23:09 user nova-compute[74429]: INFO nova.compute.claims [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Claim successful on node user
Oct 23 20:23:09 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:23:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing instance network info cache due to event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.policy [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8220ac323e7245e69a908f2cb9405cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf265c64a1d42d7bbc7afd948fa1feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:23:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Creating image(s)
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "/opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "/opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "/opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.205s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk 1073741824" returned: 0 in 0.070s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:10 user nova-compute[74429]: INFO nova.compute.manager [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Detaching volume ee377a76-d404-4702-ad9b-029244f67140
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updated VIF entry in instance network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Successfully created port: 72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:23:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1be9f6f5-07f4-40f0-8b34-124878a31a07 req-28eb7391-40a5-45b4-95a3-3bd3eafd0ad1 service nova] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:23:10 user nova-compute[74429]: INFO nova.virt.block_device [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Attempting to driver detach volume ee377a76-d404-4702-ad9b-029244f67140 from mountpoint /dev/vdb
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Attempting to detach device vdb from instance 46650715-39f9-4753-a858-8f81ba2c24d5 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:23:11 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:23:11 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:23:11 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:23:11 user nova-compute[74429]:   <serial>ee377a76-d404-4702-ad9b-029244f67140</serial>
Oct 23 20:23:11 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:23:11 user nova-compute[74429]: </disk>
Oct 23 20:23:11 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:11 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully detached device vdb from instance 46650715-39f9-4753-a858-8f81ba2c24d5 from the persistent domain config.
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46650715-39f9-4753-a858-8f81ba2c24d5 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:23:11 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:23:11 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:23:11 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:23:11 user nova-compute[74429]:   <serial>ee377a76-d404-4702-ad9b-029244f67140</serial>
Oct 23 20:23:11 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:23:11 user nova-compute[74429]: </disk>
Oct 23 20:23:11 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Cannot resize image /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Ensure instance console log exists: /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Successfully updated port: 72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "refresh_cache-e213a14b-bed9-4bab-9545-d032140adab7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquired lock "refresh_cache-e213a14b-bed9-4bab-9545-d032140adab7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:23:11 user nova-compute[74429]: DEBUG nova.network.neutron [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.neutron [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Updating instance_info_cache with network_info: [{"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Releasing lock "refresh_cache-e213a14b-bed9-4bab-9545-d032140adab7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Instance network_info: |[{"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Start _get_guest_xml network_info=[{"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:23:12 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:23:12 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2146399932',display_name='tempest-VolumesActionsTest-instance-2146399932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2146399932',id=35,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf265c64a1d42d7bbc7afd948fa1feb',ramdisk_id='',reservation_id='r-vc7i1x97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-805266683',owner_user_name='tempest-VolumesActionsTest-805266683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:23:10Z,user_data=None,user_id='8220ac323e7245e69a908f2cb9405cf0',uuid=e213a14b-bed9-4bab-9545-d032140adab7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converting VIF {"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lazy-loading 'pci_devices' on Instance uuid e213a14b-bed9-4bab-9545-d032140adab7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:23:12 user nova-compute[74429]:   <uuid>e213a14b-bed9-4bab-9545-d032140adab7</uuid>
Oct 23 20:23:12 user nova-compute[74429]:   <name>instance-00000023</name>
Oct 23 20:23:12 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:23:12 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:23:12 user nova-compute[74429]:   <metadata>
Oct 23 20:23:12 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:23:12 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:23:12 user nova-compute[74429]:       <nova:name>tempest-VolumesActionsTest-instance-2146399932</nova:name>
Oct 23 20:23:12 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:23:12</nova:creationTime>
Oct 23 20:23:12 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:23:12 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:23:12 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:23:12 user nova-compute[74429]:       <nova:owner>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:user uuid="8220ac323e7245e69a908f2cb9405cf0">tempest-VolumesActionsTest-805266683-project-member</nova:user>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:project uuid="0bf265c64a1d42d7bbc7afd948fa1feb">tempest-VolumesActionsTest-805266683</nova:project>
Oct 23 20:23:12 user nova-compute[74429]:       </nova:owner>
Oct 23 20:23:12 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:23:12 user nova-compute[74429]:       <nova:ports>
Oct 23 20:23:12 user nova-compute[74429]:         <nova:port uuid="72d79b38-5134-438e-a053-9df9a02833c6">
Oct 23 20:23:12 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 20:23:12 user nova-compute[74429]:         </nova:port>
Oct 23 20:23:12 user nova-compute[74429]:       </nova:ports>
Oct 23 20:23:12 user nova-compute[74429]:     </nova:instance>
Oct 23 20:23:12 user nova-compute[74429]:   </metadata>
Oct 23 20:23:12 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:23:12 user nova-compute[74429]:     <system>
Oct 23 20:23:12 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:23:12 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:23:12 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:23:12 user nova-compute[74429]:       <entry name="serial">e213a14b-bed9-4bab-9545-d032140adab7</entry>
Oct 23 20:23:12 user nova-compute[74429]:       <entry name="uuid">e213a14b-bed9-4bab-9545-d032140adab7</entry>
Oct 23 20:23:12 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:23:12 user nova-compute[74429]:     </system>
Oct 23 20:23:12 user nova-compute[74429]:   </sysinfo>
Oct 23 20:23:12 user nova-compute[74429]:   <os>
Oct 23 20:23:12 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:23:12 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:23:12 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:23:12 user nova-compute[74429]:   </os>
Oct 23 20:23:12 user nova-compute[74429]:   <features>
Oct 23 20:23:12 user nova-compute[74429]:     <acpi/>
Oct 23 20:23:12 user nova-compute[74429]:     <apic/>
Oct 23 20:23:12 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:23:12 user nova-compute[74429]:   </features>
Oct 23 20:23:12 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:23:12 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:23:12 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:23:12 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:23:12 user nova-compute[74429]:   </clock>
Oct 23 20:23:12 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:23:12 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:23:12 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:23:12 user nova-compute[74429]:   </cpu>
Oct 23 20:23:12 user nova-compute[74429]:   <devices>
Oct 23 20:23:12 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:23:12 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:23:12 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk"/>
Oct 23 20:23:12 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:23:12 user nova-compute[74429]:     </disk>
Oct 23 20:23:12 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:23:12 user nova-compute[74429]:       <mac address="fa:16:3e:7a:e2:1b"/>
Oct 23 20:23:12 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:23:12 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:23:12 user nova-compute[74429]:       <target dev="tap72d79b38-51"/>
Oct 23 20:23:12 user nova-compute[74429]:     </interface>
Oct 23 20:23:12 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:23:12 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/console.log" append="off"/>
Oct 23 20:23:12 user nova-compute[74429]:     </serial>
Oct 23 20:23:12 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:23:12 user nova-compute[74429]:     <video>
Oct 23 20:23:12 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:23:12 user nova-compute[74429]:     </video>
Oct 23 20:23:12 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:23:12 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:23:12 user nova-compute[74429]:     </rng>
Oct 23 20:23:12 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:23:12 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:23:12 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:23:12 user nova-compute[74429]:     </memballoon>
Oct 23 20:23:12 user nova-compute[74429]:   </devices>
Oct 23 20:23:12 user nova-compute[74429]: </domain>
Oct 23 20:23:12 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2146399932',display_name='tempest-VolumesActionsTest-instance-2146399932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2146399932',id=35,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf265c64a1d42d7bbc7afd948fa1feb',ramdisk_id='',reservation_id='r-vc7i1x97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-805266683',owner_user_name='tempest-VolumesActionsTest-805266683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:23:10Z,user_data=None,user_id='8220ac323e7245e69a908f2cb9405cf0',uuid=e213a14b-bed9-4bab-9545-d032140adab7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converting VIF {"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG os_vif [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b48a7ce-e6f4-5bfa-a9c2-a84fa1941571', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72d79b38-51, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72d79b38-51, col_values=(('qos', UUID('d6ba52ea-0a30-4330-a84b-5cd7eb1a17e8')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72d79b38-51, col_values=(('external_ids', {'iface-id': '72d79b38-5134-438e-a053-9df9a02833c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:e2:1b', 'vm-uuid': 'e213a14b-bed9-4bab-9545-d032140adab7'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:12 user nova-compute[74429]: INFO os_vif [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51')
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] No VIF found with MAC fa:16:3e:7a:e2:1b, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing instance network info cache due to event network-changed-031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] Acquiring lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] Acquired lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Refreshing network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updated VIF entry in instance network info cache for port 031e39fe-e85e-4156-8f81-9e8341ffa00c. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [{"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] Releasing lock "refresh_cache-46650715-39f9-4753-a858-8f81ba2c24d5" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-changed-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Refreshing instance network info cache due to event network-changed-72d79b38-5134-438e-a053-9df9a02833c6. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] Acquiring lock "refresh_cache-e213a14b-bed9-4bab-9545-d032140adab7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] Acquired lock "refresh_cache-e213a14b-bed9-4bab-9545-d032140adab7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:23:12 user nova-compute[74429]: DEBUG nova.network.neutron [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Refreshing network info cache for port 72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Updated VIF entry in instance network info cache for port 72d79b38-5134-438e-a053-9df9a02833c6. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG nova.network.neutron [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Updating instance_info_cache with network_info: [{"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4725e342-ffe0-45cc-b21a-41352ae80093 req-dc440554-042d-4674-b08f-3123ca006c1c service nova] Releasing lock "refresh_cache-e213a14b-bed9-4bab-9545-d032140adab7" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1151ca0-0167-4da8-ae34-43cca62896c0 req-594144e6-2464-4977-844d-e6971a559fd1 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1151ca0-0167-4da8-ae34-43cca62896c0 req-594144e6-2464-4977-844d-e6971a559fd1 service nova] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1151ca0-0167-4da8-ae34-43cca62896c0 req-594144e6-2464-4977-844d-e6971a559fd1 service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1151ca0-0167-4da8-ae34-43cca62896c0 req-594144e6-2464-4977-844d-e6971a559fd1 service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1151ca0-0167-4da8-ae34-43cca62896c0 req-594144e6-2464-4977-844d-e6971a559fd1 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] No waiting events found dispatching network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:23:13 user nova-compute[74429]: WARNING nova.compute.manager [req-f1151ca0-0167-4da8-ae34-43cca62896c0 req-594144e6-2464-4977-844d-e6971a559fd1 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received unexpected event network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 for instance with vm_state building and task_state spawning.
Oct 23 20:23:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:23:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Instance spawned successfully.
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-a69dc7ab-44e6-4dbf-83da-6f3de0c3fbf4 req-348518ea-c03f-44b2-b59c-8c6046444ca6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a69dc7ab-44e6-4dbf-83da-6f3de0c3fbf4 req-348518ea-c03f-44b2-b59c-8c6046444ca6 service nova] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a69dc7ab-44e6-4dbf-83da-6f3de0c3fbf4 req-348518ea-c03f-44b2-b59c-8c6046444ca6 service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a69dc7ab-44e6-4dbf-83da-6f3de0c3fbf4 req-348518ea-c03f-44b2-b59c-8c6046444ca6 service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-a69dc7ab-44e6-4dbf-83da-6f3de0c3fbf4 req-348518ea-c03f-44b2-b59c-8c6046444ca6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] No waiting events found dispatching network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:23:15 user nova-compute[74429]: WARNING nova.compute.manager [req-a69dc7ab-44e6-4dbf-83da-6f3de0c3fbf4 req-348518ea-c03f-44b2-b59c-8c6046444ca6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received unexpected event network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 for instance with vm_state building and task_state spawning.
Oct 23 20:23:15 user nova-compute[74429]: INFO nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 23 20:23:15 user nova-compute[74429]: DEBUG nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:23:15 user nova-compute[74429]: INFO nova.compute.manager [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Took 6.31 seconds to build instance.
Oct 23 20:23:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-073d5e81-efbe-4f86-92fc-9ecdd90d7e5f tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "e213a14b-bed9-4bab-9545-d032140adab7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.426s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:17 user nova-compute[74429]: INFO nova.compute.manager [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Terminating instance
Oct 23 20:23:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-b61dd8c8-639a-4f81-a75f-19248474b03f req-4a28008c-7bed-49c4-8623-ad6eab934a0f service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-vif-unplugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b61dd8c8-639a-4f81-a75f-19248474b03f req-4a28008c-7bed-49c4-8623-ad6eab934a0f service nova] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b61dd8c8-639a-4f81-a75f-19248474b03f req-4a28008c-7bed-49c4-8623-ad6eab934a0f service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b61dd8c8-639a-4f81-a75f-19248474b03f req-4a28008c-7bed-49c4-8623-ad6eab934a0f service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-b61dd8c8-639a-4f81-a75f-19248474b03f req-4a28008c-7bed-49c4-8623-ad6eab934a0f service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] No waiting events found dispatching network-vif-unplugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.compute.manager [req-b61dd8c8-639a-4f81-a75f-19248474b03f req-4a28008c-7bed-49c4-8623-ad6eab934a0f service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-vif-unplugged-f2a7aa16-4b78-440a-a815-9865852163a7 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:23:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Instance destroyed successfully.
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lazy-loading 'resources' on Instance uuid 1e185be0-50d7-4243-89a7-6c68c8707947 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-283502106',display_name='tempest-ServerActionsTestOtherA-server-283502106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-283502106',id=14,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3WKAm49wQ9ISbcV9OA2003xtrah0GhgQ8hF/G7vxPhnkJpOt/IksY8Dskq4QDatryoQQKNzmY1UJ/7NoMQc5c6Ubp+5OKgDaV1zAB875bgdHYQ3Ms7IrOF/yQ9NQkpQ==',key_name='tempest-keypair-1815727212',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:04:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f8768b24d954f5cbb03c242e6a3a1f1',ramdisk_id='',reservation_id='r-q1km4ag9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1925715908',owner_user_name='tempest-ServerActionsTestOtherA-1925715908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80ac3c2700c2447993ba5a8e14db0aa5',uuid=1e185be0-50d7-4243-89a7-6c68c8707947,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converting VIF {"id": "f2a7aa16-4b78-440a-a815-9865852163a7", "address": "fa:16:3e:e2:ce:b5", "network": {"id": "00a22175-21b8-4852-9d04-904c32fabc88", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-443979203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f8768b24d954f5cbb03c242e6a3a1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a7aa16-4b", "ovs_interfaceid": "f2a7aa16-4b78-440a-a815-9865852163a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG os_vif [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2a7aa16-4b, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bd62406-8526-48f1-ab93-dfe5f011bdec) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:23:18 user nova-compute[74429]: INFO os_vif [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:ce:b5,bridge_name='br-int',has_traffic_filtering=True,id=f2a7aa16-4b78-440a-a815-9865852163a7,network=Network(00a22175-21b8-4852-9d04-904c32fabc88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a7aa16-4b')
Oct 23 20:23:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Deleting instance files /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947_del
Oct 23 20:23:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Deletion of /opt/stack/data/nova/instances/1e185be0-50d7-4243-89a7-6c68c8707947_del complete
Oct 23 20:23:18 user nova-compute[74429]: INFO nova.compute.manager [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 20:23:18 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:23:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:19 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:19 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Took 0.56 seconds to deallocate network for instance.
Oct 23 20:23:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-9375cf9b-32b1-4235-8f3d-985c9fa99e59 req-c6631bb4-9d98-4a0c-a413-c2bdb91ea1c6 service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-vif-deleted-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:19 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:23:19 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:23:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:19 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Deleted allocations for instance 1e185be0-50d7-4243-89a7-6c68c8707947
Oct 23 20:23:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e18db378-295d-40ed-a539-646ad4ea6938 tempest-ServerActionsTestOtherA-1925715908 tempest-ServerActionsTestOtherA-1925715908-project-member] Lock "1e185be0-50d7-4243-89a7-6c68c8707947" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-876e185d-3d33-4df2-8bd0-6741b7fbe170 req-c719127e-9954-4db4-9a0e-a26f1dae676a service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received event network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-876e185d-3d33-4df2-8bd0-6741b7fbe170 req-c719127e-9954-4db4-9a0e-a26f1dae676a service nova] Acquiring lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-876e185d-3d33-4df2-8bd0-6741b7fbe170 req-c719127e-9954-4db4-9a0e-a26f1dae676a service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-876e185d-3d33-4df2-8bd0-6741b7fbe170 req-c719127e-9954-4db4-9a0e-a26f1dae676a service nova] Lock "1e185be0-50d7-4243-89a7-6c68c8707947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-876e185d-3d33-4df2-8bd0-6741b7fbe170 req-c719127e-9954-4db4-9a0e-a26f1dae676a service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] No waiting events found dispatching network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:23:20 user nova-compute[74429]: WARNING nova.compute.manager [req-876e185d-3d33-4df2-8bd0-6741b7fbe170 req-c719127e-9954-4db4-9a0e-a26f1dae676a service nova] [instance: 1e185be0-50d7-4243-89a7-6c68c8707947] Received unexpected event network-vif-plugged-f2a7aa16-4b78-440a-a815-9865852163a7 for instance with vm_state deleted and task_state None.
Oct 23 20:23:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:23:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:30 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:23:30 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:23:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=25.30765151977539GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 46650715-39f9-4753-a858-8f81ba2c24d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance e213a14b-bed9-4bab-9545-d032140adab7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46650715-39f9-4753-a858-8f81ba2c24d5 is timed out.
Oct 23 20:23:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully detached device vdb from instance 46650715-39f9-4753-a858-8f81ba2c24d5 from the live domain config.
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJvkVHqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:23:31 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[132064eb-36c9-408a-93d4-495a5b328e1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:23:31 user nova-compute[74429]: No targets found.
Oct 23 20:23:31 user nova-compute[74429]: iSNS:
Oct 23 20:23:31 user nova-compute[74429]: No targets found.
Oct 23 20:23:31 user nova-compute[74429]: STATIC:
Oct 23 20:23:31 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b
Oct 23 20:23:31 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:23:31 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:23:31 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140
Oct 23 20:23:31 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:23:31 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:23:31 user nova-compute[74429]: FIRMWARE:
Oct 23 20:23:31 user nova-compute[74429]: No targets found.
Oct 23 20:23:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:23:31 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:23:31 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8dff9e-b9e2-422d-a7a5-34e3902b3aa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37531b-fff7-4f84-bfe5-31deacc5c7fe]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:23:31 user nova-compute[74429]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)
Oct 23 20:23:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 (non-flash)
Oct 23 20:23:31 user nova-compute[74429]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)
Oct 23 20:23:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d58164ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a882974-d59e-45ef-b7bf-e590d48c09e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d400c0-b0d4-4c48-ad40-9e503b33dd29]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49c1909-99e5-4cec-9229-27f857059804]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c464c3-3bb0-4a4b-b8fd-ccd61d125ce9]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dfee0b-a1e0-4761-86a7-7291e1c784d7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1875108-2ee8-42c2-bbf6-6d9ca2d339c6]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260]
Oct 23 20:23:31 user nova-compute[74429]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140, portal: 172.16.0.220,3260] successful.
Oct 23 20:23:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee377a76-d404-4702-ad9b-029244f67140 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dced7c-15f7-4e2e-9002-944247fcdaf4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] <== disconnect_volume: return (279ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:23:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:23:32 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'flavor' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:23:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cd2f9ba0-44af-40d7-813b-cd7ffb5a3a6e tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:23:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [{"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-c9e64e6f-6a1d-4368-8c33-bb929888a0d9" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:23:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:23:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:36 user nova-compute[74429]: INFO nova.compute.manager [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Terminating instance
Oct 23 20:23:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d9eeb2e-e17a-4d98-a3f9-9d3cb5d1ea6e req-d8e5e263-4d34-45f4-a81d-1c890d7290f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-unplugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d9eeb2e-e17a-4d98-a3f9-9d3cb5d1ea6e req-d8e5e263-4d34-45f4-a81d-1c890d7290f2 service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d9eeb2e-e17a-4d98-a3f9-9d3cb5d1ea6e req-d8e5e263-4d34-45f4-a81d-1c890d7290f2 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8d9eeb2e-e17a-4d98-a3f9-9d3cb5d1ea6e req-d8e5e263-4d34-45f4-a81d-1c890d7290f2 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d9eeb2e-e17a-4d98-a3f9-9d3cb5d1ea6e req-d8e5e263-4d34-45f4-a81d-1c890d7290f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-unplugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.compute.manager [req-8d9eeb2e-e17a-4d98-a3f9-9d3cb5d1ea6e req-d8e5e263-4d34-45f4-a81d-1c890d7290f2 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-unplugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:23:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Instance destroyed successfully.
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lazy-loading 'resources' on Instance uuid c9e64e6f-6a1d-4368-8c33-bb929888a0d9 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T20:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1649851243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1649851243',id=33,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZv/hWeiOQys3LeBOBVbZ0ndKNBVSVXYFDMAp089G2ZET/y41dwmqnHIALULYFdf1Qif34FhZLrRGDu+ZfTfpH1suUtzWOhPIB+v/VtwNm6POEPCWa3rTDKJrPQVHbRQ==',key_name='tempest-keypair-1219360172',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:21:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35bb75b1bd846e6ac415aaefd410621',ramdisk_id='',reservation_id='r-1hqxl9ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-301170821',owner_user_name='tempest-AttachVolumeShelveTestJSON-301170821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='213b96dfb6b043aabcebdd6710ae8f4c',uuid=c9e64e6f-6a1d-4368-8c33-bb929888a0d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converting VIF {"id": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "address": "fa:16:3e:36:93:30", "network": {"id": "91607b86-bd86-4f92-9da8-c6c59bdb798b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1332307581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bb75b1bd846e6ac415aaefd410621", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f3e82c-8e", "ovs_interfaceid": "37f3e82c-8eab-4d8f-88be-29e6f10b3b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG os_vif [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37f3e82c-8e, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e401b97c-aab2-4250-bce4-8dfdaf30a483) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:37 user nova-compute[74429]: INFO os_vif [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:93:30,bridge_name='br-int',has_traffic_filtering=True,id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55,network=Network(91607b86-bd86-4f92-9da8-c6c59bdb798b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f3e82c-8e')
Oct 23 20:23:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Deleting instance files /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9_del
Oct 23 20:23:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Deletion of /opt/stack/data/nova/instances/c9e64e6f-6a1d-4368-8c33-bb929888a0d9_del complete
Oct 23 20:23:37 user nova-compute[74429]: INFO nova.compute.manager [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 23 20:23:37 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:23:37 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:38 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Took 0.99 seconds to deallocate network for instance.
Oct 23 20:23:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-de32cdfc-89f0-49b5-ae27-d112f1db1e5b req-c5d3cee4-0752-4f03-8286-469aea6ef686 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-deleted-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:38 user nova-compute[74429]: INFO nova.compute.manager [req-de32cdfc-89f0-49b5-ae27-d112f1db1e5b req-c5d3cee4-0752-4f03-8286-469aea6ef686 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Neutron deleted interface 37f3e82c-8eab-4d8f-88be-29e6f10b3b55; detaching it from the instance and deleting it from the info cache
Oct 23 20:23:38 user nova-compute[74429]: DEBUG nova.network.neutron [req-de32cdfc-89f0-49b5-ae27-d112f1db1e5b req-c5d3cee4-0752-4f03-8286-469aea6ef686 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-de32cdfc-89f0-49b5-ae27-d112f1db1e5b req-c5d3cee4-0752-4f03-8286-469aea6ef686 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Detach interface failed, port_id=37f3e82c-8eab-4d8f-88be-29e6f10b3b55, reason: Instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:38 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Deleted allocations for instance c9e64e6f-6a1d-4368-8c33-bb929888a0d9
Oct 23 20:23:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8fc23ab2-c295-4cc1-b9eb-04df499c00c8 tempest-AttachVolumeShelveTestJSON-301170821 tempest-AttachVolumeShelveTestJSON-301170821-project-member] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:39 user nova-compute[74429]: INFO nova.compute.manager [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Detaching volume 3dabcd3d-805e-435b-a5bc-8b3b05e73c9b
Oct 23 20:23:39 user nova-compute[74429]: INFO nova.virt.block_device [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attempting to driver detach volume 3dabcd3d-805e-435b-a5bc-8b3b05e73c9b from mountpoint /dev/vdb
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Attempting to detach device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:23:39 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:23:39 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:23:39 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:23:39 user nova-compute[74429]:   <serial>3dabcd3d-805e-435b-a5bc-8b3b05e73c9b</serial>
Oct 23 20:23:39 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:23:39 user nova-compute[74429]: </disk>
Oct 23 20:23:39 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:23:39 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config.
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:23:39 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:23:39 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:23:39 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:23:39 user nova-compute[74429]:   <serial>3dabcd3d-805e-435b-a5bc-8b3b05e73c9b</serial>
Oct 23 20:23:39 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:23:39 user nova-compute[74429]: </disk>
Oct 23 20:23:39 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-9f2c6ee8-63e9-437a-b45a-5bf3405a613e req-fbd0c758-40f0-4b83-b186-b73f5042b463 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9f2c6ee8-63e9-437a-b45a-5bf3405a613e req-fbd0c758-40f0-4b83-b186-b73f5042b463 service nova] Acquiring lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9f2c6ee8-63e9-437a-b45a-5bf3405a613e req-fbd0c758-40f0-4b83-b186-b73f5042b463 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9f2c6ee8-63e9-437a-b45a-5bf3405a613e req-fbd0c758-40f0-4b83-b186-b73f5042b463 service nova] Lock "c9e64e6f-6a1d-4368-8c33-bb929888a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.compute.manager [req-9f2c6ee8-63e9-437a-b45a-5bf3405a613e req-fbd0c758-40f0-4b83-b186-b73f5042b463 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] No waiting events found dispatching network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:23:39 user nova-compute[74429]: WARNING nova.compute.manager [req-9f2c6ee8-63e9-437a-b45a-5bf3405a613e req-fbd0c758-40f0-4b83-b186-b73f5042b463 service nova] [instance: c9e64e6f-6a1d-4368-8c33-bb929888a0d9] Received unexpected event network-vif-plugged-37f3e82c-8eab-4d8f-88be-29e6f10b3b55 for instance with vm_state deleted and task_state None.
Oct 23 20:23:39 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:23:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:23:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:23:59 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 is timed out.
Oct 23 20:23:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config.
Oct 23 20:23:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTqGtaJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:23:59 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7dacf7-d61f-42a6-ab38-03e0b7ffc51b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:23:59 user nova-compute[74429]: No targets found.
Oct 23 20:23:59 user nova-compute[74429]: iSNS:
Oct 23 20:23:59 user nova-compute[74429]: No targets found.
Oct 23 20:23:59 user nova-compute[74429]: STATIC:
Oct 23 20:23:59 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b
Oct 23 20:23:59 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:23:59 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:23:59 user nova-compute[74429]: FIRMWARE:
Oct 23 20:23:59 user nova-compute[74429]: No targets found.
Oct 23 20:23:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:23:59 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:23:59 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b003c169-d429-4707-b72b-28c0e0b4faa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab834491-b17f-4d01-96c5-1dbd278c5a28]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)
Oct 23 20:23:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b (non-flash)
Oct 23 20:23:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c58b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46c7ef3-edfb-454c-991e-01ef1b2769c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6da11f8-3e2b-4f62-b232-7f1378e06d00]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e74363-3a45-4dde-b6dd-0ef61e4799f3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a38210-f01d-45c6-946c-192275aab3fc]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad0b9a-c5c6-4a68-859a-0baa2e51b636]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[978f3405-6c62-434f-96a2-570a5ee05126]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260]
Oct 23 20:23:59 user nova-compute[74429]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b, portal: 172.16.0.220,3260] successful.
Oct 23 20:23:59 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dabcd3d-805e-435b-a5bc-8b3b05e73c9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771a4e4-e0df-4ffe-bdcd-a106d99b169a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== disconnect_volume: return (274ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:23:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:24:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:24:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9b0ce8e8-2848-404d-854b-779892cbb2da tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:01 user nova-compute[74429]: INFO nova.compute.manager [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Terminating instance
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-e80f137c-1ccb-4673-ac7c-a4104e027f5b req-272136cc-3f9e-432f-b5e0-37634f0cad92 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e80f137c-1ccb-4673-ac7c-a4104e027f5b req-272136cc-3f9e-432f-b5e0-37634f0cad92 service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e80f137c-1ccb-4673-ac7c-a4104e027f5b req-272136cc-3f9e-432f-b5e0-37634f0cad92 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e80f137c-1ccb-4673-ac7c-a4104e027f5b req-272136cc-3f9e-432f-b5e0-37634f0cad92 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-e80f137c-1ccb-4673-ac7c-a4104e027f5b req-272136cc-3f9e-432f-b5e0-37634f0cad92 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-e80f137c-1ccb-4673-ac7c-a4104e027f5b req-272136cc-3f9e-432f-b5e0-37634f0cad92 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-unplugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Instance destroyed successfully.
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.objects.instance [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'resources' on Instance uuid 46650715-39f9-4753-a858-8f81ba2c24d5 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1037066447',display_name='tempest-ServerRescueNegativeTestJSON-server-1037066447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1037066447',id=31,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwFn5JPNee3X1sxsdYNzK74zVoN6EDJFv00X3A9JTtBfOGcU4p/W0FbxvUwxrVuUp62R9t/tz+fskvkTmhA5LulvkXZiK+Rb4nvvNcYh8X03BNLWX+SipLJptGVIDIx0w==',key_name='tempest-keypair-1915459799',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-ld4nsqvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=46650715-39f9-4753-a858-8f81ba2c24d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "address": "fa:16:3e:db:5d:9a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031e39fe-e8", "ovs_interfaceid": "031e39fe-e85e-4156-8f81-9e8341ffa00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG os_vif [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap031e39fe-e8, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e97c9ea-6dc4-4115-ba9d-c682a62e909a) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:01 user nova-compute[74429]: INFO os_vif [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5d:9a,bridge_name='br-int',has_traffic_filtering=True,id=031e39fe-e85e-4156-8f81-9e8341ffa00c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031e39fe-e8')
Oct 23 20:24:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Deleting instance files /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5_del
Oct 23 20:24:01 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Deletion of /opt/stack/data/nova/instances/46650715-39f9-4753-a858-8f81ba2c24d5_del complete
Oct 23 20:24:02 user nova-compute[74429]: INFO nova.compute.manager [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 20:24:02 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:24:02 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:24:02 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:24:02 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:24:02 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Took 0.73 seconds to deallocate network for instance.
Oct 23 20:24:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:03 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Deleted allocations for instance 46650715-39f9-4753-a858-8f81ba2c24d5
Oct 23 20:24:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-486d0a0f-61fb-4700-80c7-4c03fc439c22 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "46650715-39f9-4753-a858-8f81ba2c24d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.037s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] Acquiring lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] Lock "46650715-39f9-4753-a858-8f81ba2c24d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] No waiting events found dispatching network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:24:03 user nova-compute[74429]: WARNING nova.compute.manager [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received unexpected event network-vif-plugged-031e39fe-e85e-4156-8f81-9e8341ffa00c for instance with vm_state deleted and task_state None.
Oct 23 20:24:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-51414439-0986-423d-aa67-670dcb436229 req-2b834aab-284f-4b06-9a6d-628f5719cc79 service nova] [instance: 46650715-39f9-4753-a858-8f81ba2c24d5] Received event network-vif-deleted-031e39fe-e85e-4156-8f81-9e8341ffa00c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:24:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:24:21 user nova-compute[74429]: INFO nova.compute.claims [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Claim successful on node user
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.network.neutron [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:24:21 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:24:21 user nova-compute[74429]: DEBUG nova.policy [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8399a03e24cd4cd7bbd8bdd9558d0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827ab59e22b4fa69f1475517e89727a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:24:21 user nova-compute[74429]: INFO nova.virt.block_device [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Booting with volume snapshot 14664d0a-52d7-4ae4-9c5c-1b2ec91ea700 at /dev/vda
Oct 23 20:24:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Successfully created port: 6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Successfully updated port: 6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "refresh_cache-b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquired lock "refresh_cache-b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG nova.network.neutron [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-changed-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Refreshing instance network info cache due to event network-changed-6f14a6e5-992f-4dfd-b438-2f0604430f25. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:24:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] Acquiring lock "refresh_cache-b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Updating instance_info_cache with network_info: [{"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Releasing lock "refresh_cache-b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Instance network_info: |[{"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] Acquired lock "refresh_cache-b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG nova.network.neutron [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Refreshing network info cache for port 6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG nova.network.neutron [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Updated VIF entry in instance network info cache for port 6f14a6e5-992f-4dfd-b438-2f0604430f25. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG nova.network.neutron [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Updating instance_info_cache with network_info: [{"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3b2a7925-51cc-497b-bba8-4f8cf20ea1e5 req-f2988d1f-1c03-4848-acfe-4a650c21f924 service nova] Releasing lock "refresh_cache-b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:24:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG os_brick.utils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa079fe-a153-468f-8977-c6b4114bf194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[532f6ab4-0968-40e8-a6fa-1d0ceb090304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa29d46b-56a5-49ec-8271-1b1e77ec927b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6341e8db-272c-4609-b4af-a15411dd297e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:24:27 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[932743fc-1b56-4c38-bdfa-384e7fc54fe6]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG os_brick.utils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Updating existing volume attachment record: 4d56790c-44fa-4342-ae54-fd067838bd2a {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:24:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:30 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:24:30 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=25.324787139892578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance e213a14b-bed9-4bab-9545-d032140adab7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:24:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Skipping network cache update for instance because it is Building. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:24:34 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [{"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-6c590343-5b24-4425-90be-423c44902c73" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:35 user nova-compute[74429]: INFO nova.compute.manager [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attaching volume 4c0afde2-dabf-4e82-a005-ac50817a9dc8 to /dev/vdb
Oct 23 20:24:35 user nova-compute[74429]: DEBUG os_brick.utils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[46740dba-9081-4a12-b364-2470dfd4f33a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[56748f01-1b25-47eb-b2a9-919533cb5d63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a37e08-bb4c-4ba1-92dd-a66993e7f28f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[94547421-45c5-42c6-b6e8-66571505c2c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:24:35 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:24:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85677c-c97c-4229-9690-2417fd6b6963]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG os_brick.utils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:24:35 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating existing volume attachment record: f4b142bd-766b-4a3c-abee-99eca202e71f {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:24:36 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:24:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:24:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Creating image(s)
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Ensure instance console log exists: /opt/stack/data/nova/instances/b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Start _get_guest_xml network_info=[{"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '4d56790c-44fa-4342-ae54-fd067838bd2a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuKvkGFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29', 'attached_at': '', 'detached_at': '', 'volume_id': '9c277877-0e37-4c93-a9ba-a558631264d7', 'serial': '9c277877-0e37-4c93-a9ba-a558631264d7'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:24:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:24:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:24:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuKvkGFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:24:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:24:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:24:45 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[794b5797-6825-4c31-885f-ec3b1e4106af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:24:45 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd27cf1-49a5-460c-9c38-f33c7fb3a71c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7] added
Oct 23 20:24:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5276d0-5215-429d-8f1b-fb743c6d3249]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a7d31d-8c76-47be-b3c2-b4e892e9f6e7]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuKvkGFW {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuKvkGFW" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e2d97e-d6b7-4d1e-ac7c-260409235d9e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuKvkGFW'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb9313-bc5e-46bb-9f59-d2fdbbddcc6d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beada1e-2e43-4c11-b1db-0acaeffcd610]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:24:45 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:24:45 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:24:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:24:45 user nova-compute[74429]: 
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fcc510-8fed-4efd-a48d-3210085c2130]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260]
Oct 23 20:24:45 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260] successful.
Oct 23 20:24:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0a16e-09c7-44e4-9453-d2876323ec5b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb04c21-0b2b-4653-b830-86082d362f35]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:24:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:24:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac90e1-d63e-4cfc-9c4b-70361091cb97]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuKvkGFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:24:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23863333331393265', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863333331393265', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1392130738',display_name='tempest-TestVolumeBootPattern-server-1392130738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1392130738',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-5ogwh4er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:24:22Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'pci_devices' on Instance uuid b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:24:46 user nova-compute[74429]:   <uuid>b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29</uuid>
Oct 23 20:24:46 user nova-compute[74429]:   <name>instance-00000024</name>
Oct 23 20:24:46 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:24:46 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:24:46 user nova-compute[74429]:   <metadata>
Oct 23 20:24:46 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:24:46 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:24:46 user nova-compute[74429]:       <nova:name>tempest-TestVolumeBootPattern-server-1392130738</nova:name>
Oct 23 20:24:46 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:24:44</nova:creationTime>
Oct 23 20:24:46 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:24:46 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:24:46 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:24:46 user nova-compute[74429]:       <nova:owner>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:user uuid="8399a03e24cd4cd7bbd8bdd9558d0798">tempest-TestVolumeBootPattern-2072234131-project-member</nova:user>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:project uuid="6827ab59e22b4fa69f1475517e89727a">tempest-TestVolumeBootPattern-2072234131</nova:project>
Oct 23 20:24:46 user nova-compute[74429]:       </nova:owner>
Oct 23 20:24:46 user nova-compute[74429]:       <nova:ports>
Oct 23 20:24:46 user nova-compute[74429]:         <nova:port uuid="6f14a6e5-992f-4dfd-b438-2f0604430f25">
Oct 23 20:24:46 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:24:46 user nova-compute[74429]:         </nova:port>
Oct 23 20:24:46 user nova-compute[74429]:       </nova:ports>
Oct 23 20:24:46 user nova-compute[74429]:     </nova:instance>
Oct 23 20:24:46 user nova-compute[74429]:   </metadata>
Oct 23 20:24:46 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:24:46 user nova-compute[74429]:     <system>
Oct 23 20:24:46 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:24:46 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:24:46 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:24:46 user nova-compute[74429]:       <entry name="serial">b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29</entry>
Oct 23 20:24:46 user nova-compute[74429]:       <entry name="uuid">b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29</entry>
Oct 23 20:24:46 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:24:46 user nova-compute[74429]:     </system>
Oct 23 20:24:46 user nova-compute[74429]:   </sysinfo>
Oct 23 20:24:46 user nova-compute[74429]:   <os>
Oct 23 20:24:46 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:24:46 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:24:46 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:24:46 user nova-compute[74429]:   </os>
Oct 23 20:24:46 user nova-compute[74429]:   <features>
Oct 23 20:24:46 user nova-compute[74429]:     <acpi/>
Oct 23 20:24:46 user nova-compute[74429]:     <apic/>
Oct 23 20:24:46 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:24:46 user nova-compute[74429]:   </features>
Oct 23 20:24:46 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:24:46 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:24:46 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:24:46 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:24:46 user nova-compute[74429]:   </clock>
Oct 23 20:24:46 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:24:46 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:24:46 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:24:46 user nova-compute[74429]:   </cpu>
Oct 23 20:24:46 user nova-compute[74429]:   <devices>
Oct 23 20:24:46 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:24:46 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:24:46 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:24:46 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:24:46 user nova-compute[74429]:       <serial>9c277877-0e37-4c93-a9ba-a558631264d7</serial>
Oct 23 20:24:46 user nova-compute[74429]:     </disk>
Oct 23 20:24:46 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:24:46 user nova-compute[74429]:       <mac address="fa:16:3e:2b:4f:68"/>
Oct 23 20:24:46 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:24:46 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:24:46 user nova-compute[74429]:       <target dev="tap6f14a6e5-99"/>
Oct 23 20:24:46 user nova-compute[74429]:     </interface>
Oct 23 20:24:46 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:24:46 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29/console.log" append="off"/>
Oct 23 20:24:46 user nova-compute[74429]:     </serial>
Oct 23 20:24:46 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:24:46 user nova-compute[74429]:     <video>
Oct 23 20:24:46 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:24:46 user nova-compute[74429]:     </video>
Oct 23 20:24:46 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:24:46 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:24:46 user nova-compute[74429]:     </rng>
Oct 23 20:24:46 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:24:46 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:24:46 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:24:46 user nova-compute[74429]:     </memballoon>
Oct 23 20:24:46 user nova-compute[74429]:   </devices>
Oct 23 20:24:46 user nova-compute[74429]: </domain>
Oct 23 20:24:46 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1392130738',display_name='tempest-TestVolumeBootPattern-server-1392130738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1392130738',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-5ogwh4er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:24:22Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG os_vif [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89e67a34-3391-55ca-8b27-bd935e320641', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f14a6e5-99, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f14a6e5-99, col_values=(('qos', UUID('d0b9cfc0-a51c-478d-9c0e-dda3c36b1687')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f14a6e5-99, col_values=(('external_ids', {'iface-id': '6f14a6e5-992f-4dfd-b438-2f0604430f25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:4f:68', 'vm-uuid': 'b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:46 user nova-compute[74429]: INFO os_vif [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99')
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:24:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No VIF found with MAC fa:16:3e:2b:4f:68, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:24:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-f9de4af2-c786-4e2c-a8d0-ce142c0bcbd3 req-af7e801c-a4b9-47bb-9f26-43581aee508a service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f9de4af2-c786-4e2c-a8d0-ce142c0bcbd3 req-af7e801c-a4b9-47bb-9f26-43581aee508a service nova] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f9de4af2-c786-4e2c-a8d0-ce142c0bcbd3 req-af7e801c-a4b9-47bb-9f26-43581aee508a service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f9de4af2-c786-4e2c-a8d0-ce142c0bcbd3 req-af7e801c-a4b9-47bb-9f26-43581aee508a service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG nova.compute.manager [req-f9de4af2-c786-4e2c-a8d0-ce142c0bcbd3 req-af7e801c-a4b9-47bb-9f26-43581aee508a service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] No waiting events found dispatching network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:24:48 user nova-compute[74429]: WARNING nova.compute.manager [req-f9de4af2-c786-4e2c-a8d0-ce142c0bcbd3 req-af7e801c-a4b9-47bb-9f26-43581aee508a service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received unexpected event network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 for instance with vm_state building and task_state spawning.
Oct 23 20:24:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:24:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Instance spawned successfully.
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:24:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:24:50 user nova-compute[74429]: INFO nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 23 20:24:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:24:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-18808229-6ac4-41df-bb74-f72bc3eb74b3 req-c2a533c4-335f-4a0b-b79c-b529b3d90792 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:24:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-18808229-6ac4-41df-bb74-f72bc3eb74b3 req-c2a533c4-335f-4a0b-b79c-b529b3d90792 service nova] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:24:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-18808229-6ac4-41df-bb74-f72bc3eb74b3 req-c2a533c4-335f-4a0b-b79c-b529b3d90792 service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:24:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-18808229-6ac4-41df-bb74-f72bc3eb74b3 req-c2a533c4-335f-4a0b-b79c-b529b3d90792 service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-18808229-6ac4-41df-bb74-f72bc3eb74b3 req-c2a533c4-335f-4a0b-b79c-b529b3d90792 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] No waiting events found dispatching network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:24:50 user nova-compute[74429]: WARNING nova.compute.manager [req-18808229-6ac4-41df-bb74-f72bc3eb74b3 req-c2a533c4-335f-4a0b-b79c-b529b3d90792 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received unexpected event network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 for instance with vm_state building and task_state spawning.
Oct 23 20:24:50 user nova-compute[74429]: INFO nova.compute.manager [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Took 28.91 seconds to build instance.
Oct 23 20:24:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-05bfee68-1b8f-4ac2-b848-9abb0e780b46 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.010s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:24:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:24:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "e213a14b-bed9-4bab-9545-d032140adab7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:00 user nova-compute[74429]: INFO nova.compute.manager [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Terminating instance
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-3f998379-01ae-49d2-8b8f-5308bf975dd9 req-6a3033d7-24cb-4d02-bb50-ca685a5b046f service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-vif-unplugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3f998379-01ae-49d2-8b8f-5308bf975dd9 req-6a3033d7-24cb-4d02-bb50-ca685a5b046f service nova] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3f998379-01ae-49d2-8b8f-5308bf975dd9 req-6a3033d7-24cb-4d02-bb50-ca685a5b046f service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3f998379-01ae-49d2-8b8f-5308bf975dd9 req-6a3033d7-24cb-4d02-bb50-ca685a5b046f service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-3f998379-01ae-49d2-8b8f-5308bf975dd9 req-6a3033d7-24cb-4d02-bb50-ca685a5b046f service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] No waiting events found dispatching network-vif-unplugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-3f998379-01ae-49d2-8b8f-5308bf975dd9 req-6a3033d7-24cb-4d02-bb50-ca685a5b046f service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-vif-unplugged-72d79b38-5134-438e-a053-9df9a02833c6 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:25:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Instance destroyed successfully.
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lazy-loading 'resources' on Instance uuid e213a14b-bed9-4bab-9545-d032140adab7 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2146399932',display_name='tempest-VolumesActionsTest-instance-2146399932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2146399932',id=35,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf265c64a1d42d7bbc7afd948fa1feb',ramdisk_id='',reservation_id='r-vc7i1x97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-805266683',owner_user_name='tempest-VolumesActionsTest-805266683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:23:16Z,user_data=None,user_id='8220ac323e7245e69a908f2cb9405cf0',uuid=e213a14b-bed9-4bab-9545-d032140adab7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converting VIF {"id": "72d79b38-5134-438e-a053-9df9a02833c6", "address": "fa:16:3e:7a:e2:1b", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72d79b38-51", "ovs_interfaceid": "72d79b38-5134-438e-a053-9df9a02833c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG os_vif [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72d79b38-51, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6ba52ea-0a30-4330-a84b-5cd7eb1a17e8) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:00 user nova-compute[74429]: INFO os_vif [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=72d79b38-5134-438e-a053-9df9a02833c6,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72d79b38-51')
Oct 23 20:25:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Deleting instance files /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7_del
Oct 23 20:25:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Deletion of /opt/stack/data/nova/instances/e213a14b-bed9-4bab-9545-d032140adab7_del complete
Oct 23 20:25:01 user nova-compute[74429]: INFO nova.compute.manager [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 20:25:01 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: e213a14b-bed9-4bab-9545-d032140adab7] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:01 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Took 0.52 seconds to deallocate network for instance.
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-d352b3c9-c709-46b0-aa2b-9e25f0bc659e req-857b3a46-c295-4943-ba32-ce8694a244b6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-vif-deleted-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:01 user nova-compute[74429]: INFO nova.compute.manager [req-d352b3c9-c709-46b0-aa2b-9e25f0bc659e req-857b3a46-c295-4943-ba32-ce8694a244b6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Neutron deleted interface 72d79b38-5134-438e-a053-9df9a02833c6; detaching it from the instance and deleting it from the info cache
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-d352b3c9-c709-46b0-aa2b-9e25f0bc659e req-857b3a46-c295-4943-ba32-ce8694a244b6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.compute.manager [req-d352b3c9-c709-46b0-aa2b-9e25f0bc659e req-857b3a46-c295-4943-ba32-ce8694a244b6 service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Detach interface failed, port_id=72d79b38-5134-438e-a053-9df9a02833c6, reason: Instance e213a14b-bed9-4bab-9545-d032140adab7 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:01 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:02 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Deleted allocations for instance e213a14b-bed9-4bab-9545-d032140adab7
Oct 23 20:25:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a32fc178-bf24-49c2-b860-08aa3a2b115a tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "e213a14b-bed9-4bab-9545-d032140adab7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-dcc687bb-bb1e-4d3d-ac8e-61e243690bed req-faa8a40c-7958-4f9f-b908-8f15e1a6f5ac service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received event network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dcc687bb-bb1e-4d3d-ac8e-61e243690bed req-faa8a40c-7958-4f9f-b908-8f15e1a6f5ac service nova] Acquiring lock "e213a14b-bed9-4bab-9545-d032140adab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dcc687bb-bb1e-4d3d-ac8e-61e243690bed req-faa8a40c-7958-4f9f-b908-8f15e1a6f5ac service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dcc687bb-bb1e-4d3d-ac8e-61e243690bed req-faa8a40c-7958-4f9f-b908-8f15e1a6f5ac service nova] Lock "e213a14b-bed9-4bab-9545-d032140adab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-dcc687bb-bb1e-4d3d-ac8e-61e243690bed req-faa8a40c-7958-4f9f-b908-8f15e1a6f5ac service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] No waiting events found dispatching network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:02 user nova-compute[74429]: WARNING nova.compute.manager [req-dcc687bb-bb1e-4d3d-ac8e-61e243690bed req-faa8a40c-7958-4f9f-b908-8f15e1a6f5ac service nova] [instance: e213a14b-bed9-4bab-9545-d032140adab7] Received unexpected event network-vif-plugged-72d79b38-5134-438e-a053-9df9a02833c6 for instance with vm_state deleted and task_state None.
Oct 23 20:25:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIetdrCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:25:03 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:25:03 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:25:03 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bea460-6f3f-4b8e-baca-826190c3c876]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:25:03 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb0338-a7d6-4093-a624-acd647e97907]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8] added
Oct 23 20:25:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16268b9-b405-437e-9fab-76849c801c85]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89ff383-9e36-4143-b9f1-ad77c2473979]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIetdrCN {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIetdrCN" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57d1c6-b786-49cc-b357-08d2658c3659]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIetdrCN'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74db39f-37bf-425e-a530-409666aa5dee]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c716e2-aad6-4ad2-84b3-f43dce26292c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:25:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:25:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b697f7-37d4-4e36-8ca7-766bdaca26f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260]
Oct 23 20:25:03 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260] successful.
Oct 23 20:25:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c1be8-25c3-4d09-a54a-820f9f7176f5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e65649-830c-4d5c-83bc-1a23fc41a449]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:25:03 user nova-compute[74429]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 (non-flash)
Oct 23 20:25:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:25:03 user nova-compute[74429]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 (non-flash)
Oct 23 20:25:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffef0b4-2b67-403a-b135-a75029857f04]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIetdrCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23836666135386433', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836666135386433', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:25:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:25:04 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:25:04 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:25:04 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:25:04 user nova-compute[74429]:   <serial>4c0afde2-dabf-4e82-a005-ac50817a9dc8</serial>
Oct 23 20:25:04 user nova-compute[74429]: </disk>
Oct 23 20:25:04 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:25:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:25:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:25:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No VIF found with MAC fa:16:3e:3d:22:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:25:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ed722eeb-8c97-4745-817f-9901955669be tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.843s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:07 user nova-compute[74429]: INFO nova.compute.manager [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Detaching volume 4c0afde2-dabf-4e82-a005-ac50817a9dc8
Oct 23 20:25:07 user nova-compute[74429]: INFO nova.virt.block_device [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attempting to driver detach volume 4c0afde2-dabf-4e82-a005-ac50817a9dc8 from mountpoint /dev/vdb
Oct 23 20:25:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Attempting to detach device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:25:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:25:07 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:25:07 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:25:07 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:25:07 user nova-compute[74429]:   <serial>4c0afde2-dabf-4e82-a005-ac50817a9dc8</serial>
Oct 23 20:25:07 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:25:07 user nova-compute[74429]: </disk>
Oct 23 20:25:07 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:25:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config.
Oct 23 20:25:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:25:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:25:07 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:25:07 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:25:07 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:25:07 user nova-compute[74429]:   <serial>4c0afde2-dabf-4e82-a005-ac50817a9dc8</serial>
Oct 23 20:25:07 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:25:07 user nova-compute[74429]: </disk>
Oct 23 20:25:07 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:25:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:25:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:14 user nova-compute[74429]: INFO nova.compute.manager [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Terminating instance
Oct 23 20:25:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c7b85d7-4bcc-4f8e-8b8b-e7883c42299b req-d6fd6f6c-c25b-41db-9baf-a6a044d5e906 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-unplugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c7b85d7-4bcc-4f8e-8b8b-e7883c42299b req-d6fd6f6c-c25b-41db-9baf-a6a044d5e906 service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c7b85d7-4bcc-4f8e-8b8b-e7883c42299b req-d6fd6f6c-c25b-41db-9baf-a6a044d5e906 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3c7b85d7-4bcc-4f8e-8b8b-e7883c42299b req-d6fd6f6c-c25b-41db-9baf-a6a044d5e906 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c7b85d7-4bcc-4f8e-8b8b-e7883c42299b req-d6fd6f6c-c25b-41db-9baf-a6a044d5e906 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-unplugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-3c7b85d7-4bcc-4f8e-8b8b-e7883c42299b req-d6fd6f6c-c25b-41db-9baf-a6a044d5e906 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-unplugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Instance destroyed successfully.
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'resources' on Instance uuid 36eb1960-5d84-4bd7-bf9b-878cfb13196f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1324301041',display_name='tempest-ServerRescueNegativeTestJSON-server-1324301041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1324301041',id=21,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-2bginkvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:10:28Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=36eb1960-5d84-4bd7-bf9b-878cfb13196f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "address": "fa:16:3e:f2:75:2a", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff08b5cd-ef", "ovs_interfaceid": "ff08b5cd-ef87-48a7-b09c-22b7adc1a88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG os_vif [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff08b5cd-ef, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=560f8857-cbf3-42c7-a61a-19acb32dec41) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:15 user nova-compute[74429]: INFO os_vif [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:75:2a,bridge_name='br-int',has_traffic_filtering=True,id=ff08b5cd-ef87-48a7-b09c-22b7adc1a88c,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff08b5cd-ef')
Oct 23 20:25:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Deleting instance files /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f_del
Oct 23 20:25:15 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Deletion of /opt/stack/data/nova/instances/36eb1960-5d84-4bd7-bf9b-878cfb13196f_del complete
Oct 23 20:25:15 user nova-compute[74429]: INFO nova.compute.manager [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 23 20:25:15 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:25:15 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:25:16 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:16 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Took 0.79 seconds to deallocate network for instance.
Oct 23 20:25:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-6d90c23e-35ad-4473-b44a-6f23a79d1f86 req-0a4d9f04-7170-4e26-ac2b-5910dc1cfc79 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-deleted-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:16 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:25:16 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:25:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:16 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Deleted allocations for instance 36eb1960-5d84-4bd7-bf9b-878cfb13196f
Oct 23 20:25:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d8e-72b6-4548-aad3-32fca3c3d851 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-a68d58da-d1af-4617-be26-4e191dfcebf6 req-07cfa17a-a004-48eb-9a29-094d61b201f4 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a68d58da-d1af-4617-be26-4e191dfcebf6 req-07cfa17a-a004-48eb-9a29-094d61b201f4 service nova] Acquiring lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a68d58da-d1af-4617-be26-4e191dfcebf6 req-07cfa17a-a004-48eb-9a29-094d61b201f4 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a68d58da-d1af-4617-be26-4e191dfcebf6 req-07cfa17a-a004-48eb-9a29-094d61b201f4 service nova] Lock "36eb1960-5d84-4bd7-bf9b-878cfb13196f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-a68d58da-d1af-4617-be26-4e191dfcebf6 req-07cfa17a-a004-48eb-9a29-094d61b201f4 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] No waiting events found dispatching network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:17 user nova-compute[74429]: WARNING nova.compute.manager [req-a68d58da-d1af-4617-be26-4e191dfcebf6 req-07cfa17a-a004-48eb-9a29-094d61b201f4 service nova] [instance: 36eb1960-5d84-4bd7-bf9b-878cfb13196f] Received unexpected event network-vif-plugged-ff08b5cd-ef87-48a7-b09c-22b7adc1a88c for instance with vm_state deleted and task_state None.
Oct 23 20:25:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:25:25 user nova-compute[74429]: INFO nova.compute.claims [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Claim successful on node user
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:25:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.policy [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91de23aa72264f5dacc767dc107809a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0a90baa2ec4f39a50b506e7349bcc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:25:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Creating image(s)
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "/opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "/opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk 1073741824" returned: 0 in 0.058s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Cannot resize image /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Ensure instance console log exists: /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:26 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Successfully created port: 22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Successfully updated port: 22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquired lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-changed-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Refreshing instance network info cache due to event network-changed-22896824-ac74-4896-95ba-4e15adf3956d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] Acquiring lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating instance_info_cache with network_info: [{"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Releasing lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Instance network_info: |[{"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] Acquired lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.neutron [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Refreshing network info cache for port 22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Start _get_guest_xml network_info=[{"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:25:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-909208154',display_name='tempest-TestServerVolumeAttachmentScenario-server-909208154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-909208154',id=37,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIDCQfCRzdZTCwlnax+gIuTZGswCjy/f/U3S66oFduqYFrurUtWMsILWv214PATawvy0JGDvzt5BhEUqTx12LPrgTPwcM7r6EXmwBJ6/IACkbaPdW71Rnf6AEWuEA5cOw==',key_name='tempest-keypair-732979404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e0a90baa2ec4f39a50b506e7349bcc9',ramdisk_id='',reservation_id='r-mhk1vldw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2002412235',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2002412235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91de23aa72264f5dacc767dc107809a6',uuid=1c7320b8-6b41-4f8d-a7f7-d0526498b6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Converting VIF {"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:25:27 user nova-compute[74429]:   <uuid>1c7320b8-6b41-4f8d-a7f7-d0526498b6f8</uuid>
Oct 23 20:25:27 user nova-compute[74429]:   <name>instance-00000025</name>
Oct 23 20:25:27 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:25:27 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:25:27 user nova-compute[74429]:   <metadata>
Oct 23 20:25:27 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:25:27 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:25:27 user nova-compute[74429]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-909208154</nova:name>
Oct 23 20:25:27 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:25:27</nova:creationTime>
Oct 23 20:25:27 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:25:27 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:25:27 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:25:27 user nova-compute[74429]:       <nova:owner>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:user uuid="91de23aa72264f5dacc767dc107809a6">tempest-TestServerVolumeAttachmentScenario-2002412235-project-member</nova:user>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:project uuid="3e0a90baa2ec4f39a50b506e7349bcc9">tempest-TestServerVolumeAttachmentScenario-2002412235</nova:project>
Oct 23 20:25:27 user nova-compute[74429]:       </nova:owner>
Oct 23 20:25:27 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:25:27 user nova-compute[74429]:       <nova:ports>
Oct 23 20:25:27 user nova-compute[74429]:         <nova:port uuid="22896824-ac74-4896-95ba-4e15adf3956d">
Oct 23 20:25:27 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:25:27 user nova-compute[74429]:         </nova:port>
Oct 23 20:25:27 user nova-compute[74429]:       </nova:ports>
Oct 23 20:25:27 user nova-compute[74429]:     </nova:instance>
Oct 23 20:25:27 user nova-compute[74429]:   </metadata>
Oct 23 20:25:27 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:25:27 user nova-compute[74429]:     <system>
Oct 23 20:25:27 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:25:27 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:25:27 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:25:27 user nova-compute[74429]:       <entry name="serial">1c7320b8-6b41-4f8d-a7f7-d0526498b6f8</entry>
Oct 23 20:25:27 user nova-compute[74429]:       <entry name="uuid">1c7320b8-6b41-4f8d-a7f7-d0526498b6f8</entry>
Oct 23 20:25:27 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:25:27 user nova-compute[74429]:     </system>
Oct 23 20:25:27 user nova-compute[74429]:   </sysinfo>
Oct 23 20:25:27 user nova-compute[74429]:   <os>
Oct 23 20:25:27 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:25:27 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:25:27 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:25:27 user nova-compute[74429]:   </os>
Oct 23 20:25:27 user nova-compute[74429]:   <features>
Oct 23 20:25:27 user nova-compute[74429]:     <acpi/>
Oct 23 20:25:27 user nova-compute[74429]:     <apic/>
Oct 23 20:25:27 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:25:27 user nova-compute[74429]:   </features>
Oct 23 20:25:27 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:25:27 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:25:27 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:25:27 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:25:27 user nova-compute[74429]:   </clock>
Oct 23 20:25:27 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:25:27 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:25:27 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:25:27 user nova-compute[74429]:   </cpu>
Oct 23 20:25:27 user nova-compute[74429]:   <devices>
Oct 23 20:25:27 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:25:27 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:25:27 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk"/>
Oct 23 20:25:27 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:25:27 user nova-compute[74429]:     </disk>
Oct 23 20:25:27 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:25:27 user nova-compute[74429]:       <mac address="fa:16:3e:8c:38:3c"/>
Oct 23 20:25:27 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:25:27 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:25:27 user nova-compute[74429]:       <target dev="tap22896824-ac"/>
Oct 23 20:25:27 user nova-compute[74429]:     </interface>
Oct 23 20:25:27 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:25:27 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/console.log" append="off"/>
Oct 23 20:25:27 user nova-compute[74429]:     </serial>
Oct 23 20:25:27 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:25:27 user nova-compute[74429]:     <video>
Oct 23 20:25:27 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:25:27 user nova-compute[74429]:     </video>
Oct 23 20:25:27 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:25:27 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:25:27 user nova-compute[74429]:     </rng>
Oct 23 20:25:27 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:25:27 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:25:27 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:25:27 user nova-compute[74429]:     </memballoon>
Oct 23 20:25:27 user nova-compute[74429]:   </devices>
Oct 23 20:25:27 user nova-compute[74429]: </domain>
Oct 23 20:25:27 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-909208154',display_name='tempest-TestServerVolumeAttachmentScenario-server-909208154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-909208154',id=37,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIDCQfCRzdZTCwlnax+gIuTZGswCjy/f/U3S66oFduqYFrurUtWMsILWv214PATawvy0JGDvzt5BhEUqTx12LPrgTPwcM7r6EXmwBJ6/IACkbaPdW71Rnf6AEWuEA5cOw==',key_name='tempest-keypair-732979404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e0a90baa2ec4f39a50b506e7349bcc9',ramdisk_id='',reservation_id='r-mhk1vldw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2002412235',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2002412235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91de23aa72264f5dacc767dc107809a6',uuid=1c7320b8-6b41-4f8d-a7f7-d0526498b6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Converting VIF {"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG os_vif [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db21fd70-449c-563c-86b5-fea8fd0efb8a', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22896824-ac, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22896824-ac, col_values=(('qos', UUID('05a44681-4959-4cdb-8bf3-fc9eb88f51d3')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22896824-ac, col_values=(('external_ids', {'iface-id': '22896824-ac74-4896-95ba-4e15adf3956d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:38:3c', 'vm-uuid': '1c7320b8-6b41-4f8d-a7f7-d0526498b6f8'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:27 user nova-compute[74429]: INFO os_vif [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac')
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:25:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No VIF found with MAC fa:16:3e:8c:38:3c, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG nova.network.neutron [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updated VIF entry in instance network info cache for port 22896824-ac74-4896-95ba-4e15adf3956d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG nova.network.neutron [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating instance_info_cache with network_info: [{"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-dc7442af-67f1-4f6d-ac12-9052e8f342c7 req-5fd7d757-e4d7-4dd9-b622-409f08be5cfe service nova] Releasing lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:25:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 is timed out.
Oct 23 20:25:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config.
Oct 23 20:25:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIetdrCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:25:28 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191499a-1a36-425d-ba71-8e8f3519c274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:25:28 user nova-compute[74429]: No targets found.
Oct 23 20:25:28 user nova-compute[74429]: iSNS:
Oct 23 20:25:28 user nova-compute[74429]: No targets found.
Oct 23 20:25:28 user nova-compute[74429]: STATIC:
Oct 23 20:25:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8
Oct 23 20:25:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:25:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:25:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7
Oct 23 20:25:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:25:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:25:28 user nova-compute[74429]: FIRMWARE:
Oct 23 20:25:28 user nova-compute[74429]: No targets found.
Oct 23 20:25:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:25:28 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:25:28 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9cbb18-2ccb-45f0-89c9-9b5a5cefb3d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0296648-d0b0-47b3-b31f-f9b801ff863a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:25:28 user nova-compute[74429]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 (non-flash)
Oct 23 20:25:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:25:28 user nova-compute[74429]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 (non-flash)
Oct 23 20:25:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d506996c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c282370-5019-408a-8a55-224ff488c0ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26fd392-bbe3-440f-9ea3-3a5b03422fe5]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[120e07ce-b01a-47a0-87e6-1e45ab15ac84]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a07be5-f4c6-439e-80d2-ec45caaeebbd]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d32ad2-bbab-4805-a105-70099d874f50]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f177504-8a66-445a-bf71-aa65a09f4e81]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260]
Oct 23 20:25:28 user nova-compute[74429]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8, portal: 172.16.0.220,3260] successful.
Oct 23 20:25:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c0afde2-dabf-4e82-a005-ac50817a9dc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff2546-4346-47ad-ac56-d6545e2ba25a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== disconnect_volume: return (288ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:25:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-63dfe878-41f4-4acb-944a-357affac00c9 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-2f9c178c-5c4f-4819-89a0-77840a6c2fbc req-3d60a01c-adf9-43c2-b584-f3583dbcfba3 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2f9c178c-5c4f-4819-89a0-77840a6c2fbc req-3d60a01c-adf9-43c2-b584-f3583dbcfba3 service nova] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2f9c178c-5c4f-4819-89a0-77840a6c2fbc req-3d60a01c-adf9-43c2-b584-f3583dbcfba3 service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2f9c178c-5c4f-4819-89a0-77840a6c2fbc req-3d60a01c-adf9-43c2-b584-f3583dbcfba3 service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-2f9c178c-5c4f-4819-89a0-77840a6c2fbc req-3d60a01c-adf9-43c2-b584-f3583dbcfba3 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] No waiting events found dispatching network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:29 user nova-compute[74429]: WARNING nova.compute.manager [req-2f9c178c-5c4f-4819-89a0-77840a6c2fbc req-3d60a01c-adf9-43c2-b584-f3583dbcfba3 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received unexpected event network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d for instance with vm_state building and task_state spawning.
Oct 23 20:25:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:25:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:25:31 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8512MB free_disk=25.358932495117188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:25:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Instance spawned successfully.
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:31 user nova-compute[74429]: INFO nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:25:31 user nova-compute[74429]: INFO nova.compute.manager [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Took 6.84 seconds to build instance.
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-1c02483e-913a-4764-90c9-29ef9eaab217 req-db521f88-9a39-496d-a5f6-b2e1598428f1 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1c02483e-913a-4764-90c9-29ef9eaab217 req-db521f88-9a39-496d-a5f6-b2e1598428f1 service nova] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1c02483e-913a-4764-90c9-29ef9eaab217 req-db521f88-9a39-496d-a5f6-b2e1598428f1 service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1c02483e-913a-4764-90c9-29ef9eaab217 req-db521f88-9a39-496d-a5f6-b2e1598428f1 service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-1c02483e-913a-4764-90c9-29ef9eaab217 req-db521f88-9a39-496d-a5f6-b2e1598428f1 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] No waiting events found dispatching network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:31 user nova-compute[74429]: WARNING nova.compute.manager [req-1c02483e-913a-4764-90c9-29ef9eaab217 req-db521f88-9a39-496d-a5f6-b2e1598428f1 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received unexpected event network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d for instance with vm_state active and task_state None.
Oct 23 20:25:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f3c09409-2a33-4e68-856f-7b8129606610 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.950s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6c590343-5b24-4425-90be-423c44902c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:25:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:25:32 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:25:32 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:25:32 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:25:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:25:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.744s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:25:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:25:35 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating instance_info_cache with network_info: [{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:25:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:25:36 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:25:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "6c590343-5b24-4425-90be-423c44902c73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "6c590343-5b24-4425-90be-423c44902c73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:25:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:25:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:25:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:25:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:25:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:25:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:25:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:51 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:25:51 user nova-compute[74429]: INFO nova.compute.claims [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Claim successful on node user
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:25:52 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.policy [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8220ac323e7245e69a908f2cb9405cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf265c64a1d42d7bbc7afd948fa1feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:25:52 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Creating image(s)
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "/opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "/opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.229s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.205s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Successfully created port: b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk 1073741824" returned: 0 in 0.056s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Cannot resize image /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Ensure instance console log exists: /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Successfully updated port: b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "refresh_cache-3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquired lock "refresh_cache-3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-changed-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Refreshing instance network info cache due to event network-changed-b4a86429-c271-4070-a52e-169578098cce. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] Acquiring lock "refresh_cache-3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.neutron [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Updating instance_info_cache with network_info: [{"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Releasing lock "refresh_cache-3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Instance network_info: |[{"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] Acquired lock "refresh_cache-3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.neutron [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Refreshing network info cache for port b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Start _get_guest_xml network_info=[{"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:25:53 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:25:53 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1457422084',display_name='tempest-VolumesActionsTest-instance-1457422084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1457422084',id=38,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf265c64a1d42d7bbc7afd948fa1feb',ramdisk_id='',reservation_id='r-4n1jse49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-805266683',owner_user_name='tempest-VolumesActionsTest-805266683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:25:52Z,user_data=None,user_id='8220ac323e7245e69a908f2cb9405cf0',uuid=3bc2c33f-debb-43c3-937b-cd8d41ba9cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converting VIF {"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:25:53 user nova-compute[74429]:   <uuid>3bc2c33f-debb-43c3-937b-cd8d41ba9cd2</uuid>
Oct 23 20:25:53 user nova-compute[74429]:   <name>instance-00000026</name>
Oct 23 20:25:53 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:25:53 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:25:53 user nova-compute[74429]:   <metadata>
Oct 23 20:25:53 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:25:53 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:25:53 user nova-compute[74429]:       <nova:name>tempest-VolumesActionsTest-instance-1457422084</nova:name>
Oct 23 20:25:53 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:25:53</nova:creationTime>
Oct 23 20:25:53 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:25:53 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:25:53 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:25:53 user nova-compute[74429]:       <nova:owner>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:user uuid="8220ac323e7245e69a908f2cb9405cf0">tempest-VolumesActionsTest-805266683-project-member</nova:user>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:project uuid="0bf265c64a1d42d7bbc7afd948fa1feb">tempest-VolumesActionsTest-805266683</nova:project>
Oct 23 20:25:53 user nova-compute[74429]:       </nova:owner>
Oct 23 20:25:53 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:25:53 user nova-compute[74429]:       <nova:ports>
Oct 23 20:25:53 user nova-compute[74429]:         <nova:port uuid="b4a86429-c271-4070-a52e-169578098cce">
Oct 23 20:25:53 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 20:25:53 user nova-compute[74429]:         </nova:port>
Oct 23 20:25:53 user nova-compute[74429]:       </nova:ports>
Oct 23 20:25:53 user nova-compute[74429]:     </nova:instance>
Oct 23 20:25:53 user nova-compute[74429]:   </metadata>
Oct 23 20:25:53 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:25:53 user nova-compute[74429]:     <system>
Oct 23 20:25:53 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:25:53 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:25:53 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:25:53 user nova-compute[74429]:       <entry name="serial">3bc2c33f-debb-43c3-937b-cd8d41ba9cd2</entry>
Oct 23 20:25:53 user nova-compute[74429]:       <entry name="uuid">3bc2c33f-debb-43c3-937b-cd8d41ba9cd2</entry>
Oct 23 20:25:53 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:25:53 user nova-compute[74429]:     </system>
Oct 23 20:25:53 user nova-compute[74429]:   </sysinfo>
Oct 23 20:25:53 user nova-compute[74429]:   <os>
Oct 23 20:25:53 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:25:53 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:25:53 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:25:53 user nova-compute[74429]:   </os>
Oct 23 20:25:53 user nova-compute[74429]:   <features>
Oct 23 20:25:53 user nova-compute[74429]:     <acpi/>
Oct 23 20:25:53 user nova-compute[74429]:     <apic/>
Oct 23 20:25:53 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:25:53 user nova-compute[74429]:   </features>
Oct 23 20:25:53 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:25:53 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:25:53 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:25:53 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:25:53 user nova-compute[74429]:   </clock>
Oct 23 20:25:53 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:25:53 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:25:53 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:25:53 user nova-compute[74429]:   </cpu>
Oct 23 20:25:53 user nova-compute[74429]:   <devices>
Oct 23 20:25:53 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:25:53 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:25:53 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk"/>
Oct 23 20:25:53 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:25:53 user nova-compute[74429]:     </disk>
Oct 23 20:25:53 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:25:53 user nova-compute[74429]:       <mac address="fa:16:3e:f7:67:fd"/>
Oct 23 20:25:53 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:25:53 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:25:53 user nova-compute[74429]:       <target dev="tapb4a86429-c2"/>
Oct 23 20:25:53 user nova-compute[74429]:     </interface>
Oct 23 20:25:53 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:25:53 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/console.log" append="off"/>
Oct 23 20:25:53 user nova-compute[74429]:     </serial>
Oct 23 20:25:53 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:25:53 user nova-compute[74429]:     <video>
Oct 23 20:25:53 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:25:53 user nova-compute[74429]:     </video>
Oct 23 20:25:53 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:25:53 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:25:53 user nova-compute[74429]:     </rng>
Oct 23 20:25:53 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:25:53 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:25:53 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:25:53 user nova-compute[74429]:     </memballoon>
Oct 23 20:25:53 user nova-compute[74429]:   </devices>
Oct 23 20:25:53 user nova-compute[74429]: </domain>
Oct 23 20:25:53 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1457422084',display_name='tempest-VolumesActionsTest-instance-1457422084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1457422084',id=38,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bf265c64a1d42d7bbc7afd948fa1feb',ramdisk_id='',reservation_id='r-4n1jse49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-805266683',owner_user_name='tempest-VolumesActionsTest-805266683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:25:52Z,user_data=None,user_id='8220ac323e7245e69a908f2cb9405cf0',uuid=3bc2c33f-debb-43c3-937b-cd8d41ba9cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converting VIF {"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG os_vif [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '387ffa9f-290a-5f5b-a644-8c6a4b6e3a9f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4a86429-c2, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4a86429-c2, col_values=(('qos', UUID('8182d42f-7803-4ea3-af81-fc946a3c2eba')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4a86429-c2, col_values=(('external_ids', {'iface-id': 'b4a86429-c271-4070-a52e-169578098cce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:67:fd', 'vm-uuid': '3bc2c33f-debb-43c3-937b-cd8d41ba9cd2'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:53 user nova-compute[74429]: INFO os_vif [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2')
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] No VIF found with MAC fa:16:3e:f7:67:fd, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:25:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:54 user nova-compute[74429]: DEBUG nova.network.neutron [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Updated VIF entry in instance network info cache for port b4a86429-c271-4070-a52e-169578098cce. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:25:54 user nova-compute[74429]: DEBUG nova.network.neutron [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Updating instance_info_cache with network_info: [{"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:25:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1d10fa2d-39b8-4c26-a720-e94f76726b30 req-8dfc0c30-dee9-45b5-9a93-6b65be31aceb service nova] Releasing lock "refresh_cache-3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-7be20aa5-8b2a-46e5-bbb9-470f9c148f0b req-4bbcf81a-2be9-436a-a771-15c58a9d289f service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7be20aa5-8b2a-46e5-bbb9-470f9c148f0b req-4bbcf81a-2be9-436a-a771-15c58a9d289f service nova] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7be20aa5-8b2a-46e5-bbb9-470f9c148f0b req-4bbcf81a-2be9-436a-a771-15c58a9d289f service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7be20aa5-8b2a-46e5-bbb9-470f9c148f0b req-4bbcf81a-2be9-436a-a771-15c58a9d289f service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-7be20aa5-8b2a-46e5-bbb9-470f9c148f0b req-4bbcf81a-2be9-436a-a771-15c58a9d289f service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] No waiting events found dispatching network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:55 user nova-compute[74429]: WARNING nova.compute.manager [req-7be20aa5-8b2a-46e5-bbb9-470f9c148f0b req-4bbcf81a-2be9-436a-a771-15c58a9d289f service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received unexpected event network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce for instance with vm_state building and task_state spawning.
Oct 23 20:25:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:25:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Instance spawned successfully.
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-a85952ec-b47f-4af5-ac37-ca03f815b658 req-5af7466d-2691-4840-8276-330a789b11d1 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a85952ec-b47f-4af5-ac37-ca03f815b658 req-5af7466d-2691-4840-8276-330a789b11d1 service nova] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a85952ec-b47f-4af5-ac37-ca03f815b658 req-5af7466d-2691-4840-8276-330a789b11d1 service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a85952ec-b47f-4af5-ac37-ca03f815b658 req-5af7466d-2691-4840-8276-330a789b11d1 service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-a85952ec-b47f-4af5-ac37-ca03f815b658 req-5af7466d-2691-4840-8276-330a789b11d1 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] No waiting events found dispatching network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:25:57 user nova-compute[74429]: WARNING nova.compute.manager [req-a85952ec-b47f-4af5-ac37-ca03f815b658 req-5af7466d-2691-4840-8276-330a789b11d1 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received unexpected event network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce for instance with vm_state building and task_state spawning.
Oct 23 20:25:57 user nova-compute[74429]: INFO nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 23 20:25:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:25:57 user nova-compute[74429]: INFO nova.compute.manager [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Took 5.89 seconds to build instance.
Oct 23 20:25:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-2d861f67-b9e4-4d13-bc56-a26eab7e46dc tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.981s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:25:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:25:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:03 user nova-compute[74429]: INFO nova.compute.manager [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attaching volume 589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf to /dev/vdb
Oct 23 20:26:03 user nova-compute[74429]: DEBUG os_brick.utils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d0d25-5f79-46a9-be99-d5688a7ec593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0895afce-ff28-41b2-82a0-40cfa8c65d4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[55541a3e-6370-4ad1-a152-a5361f6a45a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ebfe70-eeae-46ce-8d7b-1f5f6f294a50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:26:03 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:26:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[06891b1b-d967-4100-9c72-f01aaf864e23]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG os_brick.utils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating existing volume attachment record: b7e470c1-3f8b-4832-9bd4-0a4709678766 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "6c590343-5b24-4425-90be-423c44902c73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:05 user nova-compute[74429]: INFO nova.compute.manager [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Terminating instance
Oct 23 20:26:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-87daae9b-8c63-457b-beab-aa406a2f9db3 req-99a1c91b-d539-4c79-9516-4a1853d9bf14 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87daae9b-8c63-457b-beab-aa406a2f9db3 req-99a1c91b-d539-4c79-9516-4a1853d9bf14 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87daae9b-8c63-457b-beab-aa406a2f9db3 req-99a1c91b-d539-4c79-9516-4a1853d9bf14 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87daae9b-8c63-457b-beab-aa406a2f9db3 req-99a1c91b-d539-4c79-9516-4a1853d9bf14 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-87daae9b-8c63-457b-beab-aa406a2f9db3 req-99a1c91b-d539-4c79-9516-4a1853d9bf14 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:26:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-87daae9b-8c63-457b-beab-aa406a2f9db3 req-99a1c91b-d539-4c79-9516-4a1853d9bf14 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-unplugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Instance destroyed successfully.
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lazy-loading 'resources' on Instance uuid 6c590343-5b24-4425-90be-423c44902c73 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1207176885',display_name='tempest-ServerRescueNegativeTestJSON-server-1207176885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1207176885',id=20,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:13:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dbb9beb49ad42fbaf6d07c88babe563',ramdisk_id='',reservation_id='r-0v5arxxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1224059578',owner_user_name='tempest-ServerRescueNegativeTestJSON-1224059578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:15:22Z,user_data=None,user_id='c660b1cec6dd476aa14a3d0fb74ebd4a',uuid=6c590343-5b24-4425-90be-423c44902c73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converting VIF {"id": "866a6953-5f5d-4930-bf06-485bb37b77df", "address": "fa:16:3e:68:98:f0", "network": {"id": "02869c2d-1145-4549-a9f2-a8d3f696939a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-547338705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dbb9beb49ad42fbaf6d07c88babe563", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap866a6953-5f", "ovs_interfaceid": "866a6953-5f5d-4930-bf06-485bb37b77df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG os_vif [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap866a6953-5f, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5a92778-70c5-44dc-8dbc-31b6a5df18a8) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:06 user nova-compute[74429]: INFO os_vif [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:98:f0,bridge_name='br-int',has_traffic_filtering=True,id=866a6953-5f5d-4930-bf06-485bb37b77df,network=Network(02869c2d-1145-4549-a9f2-a8d3f696939a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap866a6953-5f')
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Deleting instance files /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73_del
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Deletion of /opt/stack/data/nova/instances/6c590343-5b24-4425-90be-423c44902c73_del complete
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.compute.manager [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] [instance: 6c590343-5b24-4425-90be-423c44902c73] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 20:26:06 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 6c590343-5b24-4425-90be-423c44902c73] Took 0.47 seconds to deallocate network for instance.
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-17817011-f47f-4ca3-bc5b-78cd0154c47a req-9b27fbea-8bee-4c92-ac74-d1a79a17d0c1 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-deleted-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.compute.manager [req-17817011-f47f-4ca3-bc5b-78cd0154c47a req-9b27fbea-8bee-4c92-ac74-d1a79a17d0c1 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Neutron deleted interface 866a6953-5f5d-4930-bf06-485bb37b77df; detaching it from the instance and deleting it from the info cache
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.network.neutron [req-17817011-f47f-4ca3-bc5b-78cd0154c47a req-9b27fbea-8bee-4c92-ac74-d1a79a17d0c1 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-17817011-f47f-4ca3-bc5b-78cd0154c47a req-9b27fbea-8bee-4c92-ac74-d1a79a17d0c1 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Detach interface failed, port_id=866a6953-5f5d-4930-bf06-485bb37b77df, reason: Instance 6c590343-5b24-4425-90be-423c44902c73 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:26:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:06 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Deleted allocations for instance 6c590343-5b24-4425-90be-423c44902c73
Oct 23 20:26:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cee46104-2b66-4f7c-90da-da8328f3a9b1 tempest-ServerRescueNegativeTestJSON-1224059578 tempest-ServerRescueNegativeTestJSON-1224059578-project-member] Lock "6c590343-5b24-4425-90be-423c44902c73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.740s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-1cce4f58-a1cd-4f67-8307-bacdf31ccc4a req-b2a5e7b1-de52-49eb-b028-6e551cc33571 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:26:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1cce4f58-a1cd-4f67-8307-bacdf31ccc4a req-b2a5e7b1-de52-49eb-b028-6e551cc33571 service nova] Acquiring lock "6c590343-5b24-4425-90be-423c44902c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1cce4f58-a1cd-4f67-8307-bacdf31ccc4a req-b2a5e7b1-de52-49eb-b028-6e551cc33571 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1cce4f58-a1cd-4f67-8307-bacdf31ccc4a req-b2a5e7b1-de52-49eb-b028-6e551cc33571 service nova] Lock "6c590343-5b24-4425-90be-423c44902c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-1cce4f58-a1cd-4f67-8307-bacdf31ccc4a req-b2a5e7b1-de52-49eb-b028-6e551cc33571 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] No waiting events found dispatching network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:26:07 user nova-compute[74429]: WARNING nova.compute.manager [req-1cce4f58-a1cd-4f67-8307-bacdf31ccc4a req-b2a5e7b1-de52-49eb-b028-6e551cc33571 service nova] [instance: 6c590343-5b24-4425-90be-423c44902c73] Received unexpected event network-vif-plugged-866a6953-5f5d-4930-bf06-485bb37b77df for instance with vm_state deleted and task_state None.
Oct 23 20:26:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:12 user nova-compute[74429]: INFO nova.compute.manager [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Terminating instance
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-04c0fc0a-13d6-4b03-a027-e86661139dc5 req-4e416b07-6c1b-4aba-b01d-3780a0dab801 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-vif-unplugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-04c0fc0a-13d6-4b03-a027-e86661139dc5 req-4e416b07-6c1b-4aba-b01d-3780a0dab801 service nova] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-04c0fc0a-13d6-4b03-a027-e86661139dc5 req-4e416b07-6c1b-4aba-b01d-3780a0dab801 service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-04c0fc0a-13d6-4b03-a027-e86661139dc5 req-4e416b07-6c1b-4aba-b01d-3780a0dab801 service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-04c0fc0a-13d6-4b03-a027-e86661139dc5 req-4e416b07-6c1b-4aba-b01d-3780a0dab801 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] No waiting events found dispatching network-vif-unplugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-04c0fc0a-13d6-4b03-a027-e86661139dc5 req-4e416b07-6c1b-4aba-b01d-3780a0dab801 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-vif-unplugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:26:12 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Instance destroyed successfully.
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'resources' on Instance uuid b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:24:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1392130738',display_name='tempest-TestVolumeBootPattern-server-1392130738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1392130738',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:24:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-5ogwh4er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:24:50Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "address": "fa:16:3e:2b:4f:68", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f14a6e5-99", "ovs_interfaceid": "6f14a6e5-992f-4dfd-b438-2f0604430f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_vif [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f14a6e5-99, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0b9cfc0-a51c-478d-9c0e-dda3c36b1687) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:26:12 user nova-compute[74429]: INFO os_vif [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4f:68,bridge_name='br-int',has_traffic_filtering=True,id=6f14a6e5-992f-4dfd-b438-2f0604430f25,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f14a6e5-99')
Oct 23 20:26:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuKvkGFW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:26:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7468d8-d470-4858-a31d-f4138a547699]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:26:12 user nova-compute[74429]: No targets found.
Oct 23 20:26:12 user nova-compute[74429]: iSNS:
Oct 23 20:26:12 user nova-compute[74429]: No targets found.
Oct 23 20:26:12 user nova-compute[74429]: STATIC:
Oct 23 20:26:12 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7
Oct 23 20:26:12 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:26:12 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:26:12 user nova-compute[74429]: FIRMWARE:
Oct 23 20:26:12 user nova-compute[74429]: No targets found.
Oct 23 20:26:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:26:12 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:26:12 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0c7cd-0d78-462d-963d-58fb7fdef255]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b94b535-742c-4364-a629-41e5c00210ae]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:26:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 (non-flash)
Oct 23 20:26:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d507c3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281753a-e19f-4a0f-8d7a-e2f72727c9c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c74f6cf-a094-4150-9f52-951c4280084f]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4afeea-9429-45af-9a7d-da803bd1b5fe]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:26:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[732508ee-a114-4f1c-bcfd-943c330a9c60]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf43713-e677-4dcc-9152-f1fe22c3009e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[99249a64-feb8-4a95-97fe-72689c7ec8c7]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260]
Oct 23 20:26:13 user nova-compute[74429]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7, portal: 172.16.0.220,3260] successful.
Oct 23 20:26:13 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c277877-0e37-4c93-a9ba-a558631264d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf53d2-42ef-4065-9956-794afb2c1e36]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== disconnect_volume: return (305ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:26:13 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Deleting instance files /opt/stack/data/nova/instances/b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29_del
Oct 23 20:26:13 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Deletion of /opt/stack/data/nova/instances/b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29_del complete
Oct 23 20:26:13 user nova-compute[74429]: INFO nova.compute.manager [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 23 20:26:13 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:26:13 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Took 0.37 seconds to deallocate network for instance.
Oct 23 20:26:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-6ab107fe-361b-4c4b-bcfc-2b203825c9d7 req-c04c9b40-be59-4980-9f4d-879e59c88448 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-vif-deleted-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:26:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-7eaddc02-988b-4716-8c1c-a016dac15cc6 req-62bec0f5-a0d3-4e81-aa8e-57303bd44a89 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received event network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7eaddc02-988b-4716-8c1c-a016dac15cc6 req-62bec0f5-a0d3-4e81-aa8e-57303bd44a89 service nova] Acquiring lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7eaddc02-988b-4716-8c1c-a016dac15cc6 req-62bec0f5-a0d3-4e81-aa8e-57303bd44a89 service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7eaddc02-988b-4716-8c1c-a016dac15cc6 req-62bec0f5-a0d3-4e81-aa8e-57303bd44a89 service nova] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-7eaddc02-988b-4716-8c1c-a016dac15cc6 req-62bec0f5-a0d3-4e81-aa8e-57303bd44a89 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] No waiting events found dispatching network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:26:14 user nova-compute[74429]: WARNING nova.compute.manager [req-7eaddc02-988b-4716-8c1c-a016dac15cc6 req-62bec0f5-a0d3-4e81-aa8e-57303bd44a89 service nova] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Received unexpected event network-vif-plugged-6f14a6e5-992f-4dfd-b438-2f0604430f25 for instance with vm_state active and task_state deleting.
Oct 23 20:26:14 user nova-compute[74429]: INFO nova.compute.manager [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Took 0.81 seconds to detach 1 volumes for instance.
Oct 23 20:26:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29] Deleting volume: 9c277877-0e37-4c93-a9ba-a558631264d7 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:14 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Deleted allocations for instance b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29
Oct 23 20:26:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8e6eb50c-2632-41bc-9ba1-755c826995ce tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "b9aabee1-e8a1-462a-90d7-2bb3f6a7eb29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaqjTPeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:26:20 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:26:20 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:26:20 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d91609-8f04-4bd4-9219-d050d350375a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:26:20 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[46426152-ecf9-4673-8ade-ddbb5901f458]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf] added
Oct 23 20:26:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e21fe0-0f36-4147-9c8e-b5bda4cdccc0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e64efa-2788-4ad9-b13d-8edaab0f45e9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EaqjTPeN {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EaqjTPeN" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e61212-c204-46bd-b791-b24bfbe959ad]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EaqjTPeN'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e5091a-60db-4ec3-a7d1-c0b553a4b474]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[14557e1c-f718-429b-bef5-43b4edc44d61]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:26:20 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:26:20 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:26:20 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:26:20 user nova-compute[74429]: 
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51d8e66-1fe6-4fec-acec-8a37cbc99a53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260]
Oct 23 20:26:20 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260] successful.
Oct 23 20:26:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc4eabb-b138-47a2-b444-208bd6ee0b26]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091aa6a-3d8a-4fb3-85bd-55f64a9d3d34]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf (non-flash)
Oct 23 20:26:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf (non-flash)
Oct 23 20:26:20 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ecfa7-36d4-4ee9-82c5-534ffc6f88f5]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:20 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaqjTPeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23530333339343661', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530333339343661', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:26:21 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:26:21 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:26:21 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:26:21 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:26:21 user nova-compute[74429]:   <serial>589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf</serial>
Oct 23 20:26:21 user nova-compute[74429]: </disk>
Oct 23 20:26:21 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:26:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:26:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:26:22 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No VIF found with MAC fa:16:3e:3d:22:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:26:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8ab5cb93-671c-4f29-b9d1-47f1cf1bc143 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.023s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:24 user nova-compute[74429]: INFO nova.compute.manager [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Detaching volume 589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf
Oct 23 20:26:24 user nova-compute[74429]: INFO nova.virt.block_device [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attempting to driver detach volume 589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf from mountpoint /dev/vdb
Oct 23 20:26:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Attempting to detach device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:26:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:26:24 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:26:24 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:26:24 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:26:24 user nova-compute[74429]:   <serial>589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf</serial>
Oct 23 20:26:24 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:26:24 user nova-compute[74429]: </disk>
Oct 23 20:26:24 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:26:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config.
Oct 23 20:26:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:26:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:26:24 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:26:24 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:26:24 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:26:24 user nova-compute[74429]:   <serial>589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf</serial>
Oct 23 20:26:24 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:26:24 user nova-compute[74429]: </disk>
Oct 23 20:26:24 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:26:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:26:27 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:30 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:26:30 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:32 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:26:32 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=25.320079803466797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:26:35 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:26:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:26:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:45 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 is timed out.
Oct 23 20:26:45 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config.
Oct 23 20:26:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EaqjTPeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:26:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af8e7e9-0603-4ff2-8b5d-3d2c9759a162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:26:45 user nova-compute[74429]: No targets found.
Oct 23 20:26:45 user nova-compute[74429]: iSNS:
Oct 23 20:26:45 user nova-compute[74429]: No targets found.
Oct 23 20:26:45 user nova-compute[74429]: STATIC:
Oct 23 20:26:45 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf
Oct 23 20:26:45 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:26:45 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:26:45 user nova-compute[74429]: FIRMWARE:
Oct 23 20:26:45 user nova-compute[74429]: No targets found.
Oct 23 20:26:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:26:45 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:26:45 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f38197-2f30-4b3f-a2c9-301237f97926]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e02f74-41a9-481d-91fd-75609a3da964]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf (non-flash)
Oct 23 20:26:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf (non-flash)
Oct 23 20:26:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d58164040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece4c562-f0d0-49f7-b662-f0587b330034]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd1a915-ea31-4b7a-aeb0-ae9463abaef1]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3860c1c4-3f8b-4af1-8571-d25a534e3d56]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726fff2-b906-4f8b-bb12-454cd6173b89]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b633fe-7ce1-464e-bca8-e2cf7aa60779]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335e664-913a-4f97-b67d-6d8ffe089074]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260]
Oct 23 20:26:45 user nova-compute[74429]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf, portal: 172.16.0.220,3260] successful.
Oct 23 20:26:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589e1fa1-f1f3-4fea-85ef-bdb5b823e3cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc63f35b-a071-4d04-88a3-6dd1f35a5b02]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== disconnect_volume: return (289ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:26:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:26:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:26:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-444e56da-02ea-4c81-a8ce-374bcc78ff07 tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:48 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:26:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:26:57 user nova-compute[74429]: INFO nova.compute.claims [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Claim successful on node user
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:26:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:26:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Creating image(s)
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "eeac7f8b7ea3b5084933732dcd41e1e1535702ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "eeac7f8b7ea3b5084933732dcd41e1e1535702ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:57 user nova-compute[74429]: DEBUG nova.policy [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12045265f772493984fb3d041c8e9456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1ae5a56f0d49dfb7f0aa63f8ef19ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG nova.virt.images [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] 94af6c0e-d7e9-454b-8ee8-85710969888c was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.part /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.part /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.converted" returned: 0 in 0.338s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "eeac7f8b7ea3b5084933732dcd41e1e1535702ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.139s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Successfully created port: 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "eeac7f8b7ea3b5084933732dcd41e1e1535702ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "eeac7f8b7ea3b5084933732dcd41e1e1535702ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec,backing_fmt=raw /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec,backing_fmt=raw /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk 1073741824" returned: 0 in 0.047s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "eeac7f8b7ea3b5084933732dcd41e1e1535702ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Cannot resize image /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:26:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Successfully updated port: 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing instance network info cache due to event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance network_info: |[{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Start _get_guest_xml network_info=[{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T20:26:55Z,direct_url=<?>,disk_format='qcow2',id=94af6c0e-d7e9-454b-8ee8-85710969888c,min_disk=0,min_ram=0,name='tempest-scenario-img--1361455470',owner='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T20:26:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '94af6c0e-d7e9-454b-8ee8-85710969888c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:27:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T20:26:55Z,direct_url=<?>,disk_format='qcow2',id=94af6c0e-d7e9-454b-8ee8-85710969888c,min_disk=0,min_ram=0,name='tempest-scenario-img--1361455470',owner='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T20:26:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1278903747',display_name='tempest-TestMinimumBasicScenario-server-1278903747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1278903747',id=39,image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVOu61QiuMOdhKgN23vTwIBy3ZDi/QNDbNem0dxxsQ5MvbHXsvaF8Qm9i7aYGoWDJbi34Pu/Qb2QmK1TmvOvfaf0I2gaMQloC9SU+lPc33jCOZoWhlwPv6lRvXE8O6iw==',key_name='tempest-TestMinimumBasicScenario-1983512050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-5uco920c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:26:58Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=2518683a-1e9b-4b01-9016-926336496b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'pci_devices' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:27:00 user nova-compute[74429]:   <uuid>2518683a-1e9b-4b01-9016-926336496b5f</uuid>
Oct 23 20:27:00 user nova-compute[74429]:   <name>instance-00000027</name>
Oct 23 20:27:00 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:27:00 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:27:00 user nova-compute[74429]:   <metadata>
Oct 23 20:27:00 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:27:00 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:27:00 user nova-compute[74429]:       <nova:name>tempest-TestMinimumBasicScenario-server-1278903747</nova:name>
Oct 23 20:27:00 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:27:00</nova:creationTime>
Oct 23 20:27:00 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:27:00 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:27:00 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:27:00 user nova-compute[74429]:       <nova:owner>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:user uuid="12045265f772493984fb3d041c8e9456">tempest-TestMinimumBasicScenario-1495059245-project-member</nova:user>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:project uuid="8b1ae5a56f0d49dfb7f0aa63f8ef19ec">tempest-TestMinimumBasicScenario-1495059245</nova:project>
Oct 23 20:27:00 user nova-compute[74429]:       </nova:owner>
Oct 23 20:27:00 user nova-compute[74429]:       <nova:root type="image" uuid="94af6c0e-d7e9-454b-8ee8-85710969888c"/>
Oct 23 20:27:00 user nova-compute[74429]:       <nova:ports>
Oct 23 20:27:00 user nova-compute[74429]:         <nova:port uuid="28e7e5fc-0cca-43ff-871e-bf30593b788e">
Oct 23 20:27:00 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:27:00 user nova-compute[74429]:         </nova:port>
Oct 23 20:27:00 user nova-compute[74429]:       </nova:ports>
Oct 23 20:27:00 user nova-compute[74429]:     </nova:instance>
Oct 23 20:27:00 user nova-compute[74429]:   </metadata>
Oct 23 20:27:00 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:27:00 user nova-compute[74429]:     <system>
Oct 23 20:27:00 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:27:00 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:27:00 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:27:00 user nova-compute[74429]:       <entry name="serial">2518683a-1e9b-4b01-9016-926336496b5f</entry>
Oct 23 20:27:00 user nova-compute[74429]:       <entry name="uuid">2518683a-1e9b-4b01-9016-926336496b5f</entry>
Oct 23 20:27:00 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:27:00 user nova-compute[74429]:     </system>
Oct 23 20:27:00 user nova-compute[74429]:   </sysinfo>
Oct 23 20:27:00 user nova-compute[74429]:   <os>
Oct 23 20:27:00 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:27:00 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:27:00 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:27:00 user nova-compute[74429]:   </os>
Oct 23 20:27:00 user nova-compute[74429]:   <features>
Oct 23 20:27:00 user nova-compute[74429]:     <acpi/>
Oct 23 20:27:00 user nova-compute[74429]:     <apic/>
Oct 23 20:27:00 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:27:00 user nova-compute[74429]:   </features>
Oct 23 20:27:00 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:27:00 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:27:00 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:27:00 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:27:00 user nova-compute[74429]:   </clock>
Oct 23 20:27:00 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:27:00 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:27:00 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:27:00 user nova-compute[74429]:   </cpu>
Oct 23 20:27:00 user nova-compute[74429]:   <devices>
Oct 23 20:27:00 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:27:00 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:27:00 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk"/>
Oct 23 20:27:00 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:27:00 user nova-compute[74429]:     </disk>
Oct 23 20:27:00 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:27:00 user nova-compute[74429]:       <mac address="fa:16:3e:9e:7a:d6"/>
Oct 23 20:27:00 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:27:00 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:27:00 user nova-compute[74429]:       <target dev="tap28e7e5fc-0c"/>
Oct 23 20:27:00 user nova-compute[74429]:     </interface>
Oct 23 20:27:00 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:27:00 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/console.log" append="off"/>
Oct 23 20:27:00 user nova-compute[74429]:     </serial>
Oct 23 20:27:00 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:27:00 user nova-compute[74429]:     <video>
Oct 23 20:27:00 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:27:00 user nova-compute[74429]:     </video>
Oct 23 20:27:00 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:27:00 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:27:00 user nova-compute[74429]:     </rng>
Oct 23 20:27:00 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:27:00 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:27:00 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:27:00 user nova-compute[74429]:     </memballoon>
Oct 23 20:27:00 user nova-compute[74429]:   </devices>
Oct 23 20:27:00 user nova-compute[74429]: </domain>
Oct 23 20:27:00 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1278903747',display_name='tempest-TestMinimumBasicScenario-server-1278903747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1278903747',id=39,image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVOu61QiuMOdhKgN23vTwIBy3ZDi/QNDbNem0dxxsQ5MvbHXsvaF8Qm9i7aYGoWDJbi34Pu/Qb2QmK1TmvOvfaf0I2gaMQloC9SU+lPc33jCOZoWhlwPv6lRvXE8O6iw==',key_name='tempest-TestMinimumBasicScenario-1983512050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-5uco920c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:26:58Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=2518683a-1e9b-4b01-9016-926336496b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG os_vif [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebf46f2b-3200-5f73-911e-e2cd9eeea35f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e7e5fc-0c, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e7e5fc-0c, col_values=(('qos', UUID('48a80a22-fa2d-462f-9a71-c38d55073228')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e7e5fc-0c, col_values=(('external_ids', {'iface-id': '28e7e5fc-0cca-43ff-871e-bf30593b788e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:7a:d6', 'vm-uuid': '2518683a-1e9b-4b01-9016-926336496b5f'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:00 user nova-compute[74429]: INFO os_vif [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c')
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No VIF found with MAC fa:16:3e:9e:7a:d6, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated VIF entry in instance network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c5820e37-a36a-4e81-ae04-232748a35f1c req-81236695-e2fc-417d-943e-c213bf14d701 service nova] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:27:02 user nova-compute[74429]: WARNING nova.compute.manager [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state building and task_state spawning.
Oct 23 20:27:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:27:02 user nova-compute[74429]: WARNING nova.compute.manager [req-fc2165c8-5098-421a-a0a5-4116cc704e1b req-55f2e30f-82b5-4b6e-afa5-e51273e58b32 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state building and task_state spawning.
Oct 23 20:27:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:27:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance spawned successfully.
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:04 user nova-compute[74429]: INFO nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Took 6.46 seconds to spawn the instance on the hypervisor.
Oct 23 20:27:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:27:04 user nova-compute[74429]: INFO nova.compute.manager [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Took 7.09 seconds to build instance.
Oct 23 20:27:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-52633e12-1b26-4a3d-91d0-1b428346f12c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.193s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:27:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:08 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:27:08 user nova-compute[74429]: INFO nova.compute.claims [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Claim successful on node user
Oct 23 20:27:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:27:09 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.policy [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0276e322764c476dae32a7972c7851fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3ab94102b4496082c15d4ec466eb0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:27:09 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Creating image(s)
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk 1073741824" returned: 0 in 0.057s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Successfully created port: 86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Cannot resize image /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Ensure instance console log exists: /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Successfully updated port: 86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquired lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-changed-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Refreshing instance network info cache due to event network-changed-86c31d69-4b84-4dd9-a888-7f8df151244b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] Acquiring lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating instance_info_cache with network_info: [{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Releasing lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Instance network_info: |[{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] Acquired lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Refreshing network info cache for port 86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Start _get_guest_xml network_info=[{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:27:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1036379341',display_name='tempest-AttachVolumeNegativeTest-server-1036379341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1036379341',id=40,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOA6RmvZDj9ggNHxyuiZZFDD90Yd+w/6TEuR+TJyGjFjO5qn+e7WDwB6eCZ7CkMBvaXdflu5qYuQFeNu5nHVGSS+KvesQVATPj6+sBlkGrrF8VBrqIQBUVqV/Vxgn9KOw==',key_name='tempest-keypair-1312615786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-jikhtxh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=5c7005a2-402e-46c5-be64-9978443cdf0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.objects.instance [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c7005a2-402e-46c5-be64-9978443cdf0d {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:27:10 user nova-compute[74429]:   <uuid>5c7005a2-402e-46c5-be64-9978443cdf0d</uuid>
Oct 23 20:27:10 user nova-compute[74429]:   <name>instance-00000028</name>
Oct 23 20:27:10 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:27:10 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:27:10 user nova-compute[74429]:   <metadata>
Oct 23 20:27:10 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:27:10 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:27:10 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1036379341</nova:name>
Oct 23 20:27:10 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:27:10</nova:creationTime>
Oct 23 20:27:10 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:27:10 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:27:10 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:27:10 user nova-compute[74429]:       <nova:owner>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:user uuid="0276e322764c476dae32a7972c7851fd">tempest-AttachVolumeNegativeTest-1373844485-project-member</nova:user>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:project uuid="5e3ab94102b4496082c15d4ec466eb0f">tempest-AttachVolumeNegativeTest-1373844485</nova:project>
Oct 23 20:27:10 user nova-compute[74429]:       </nova:owner>
Oct 23 20:27:10 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:27:10 user nova-compute[74429]:       <nova:ports>
Oct 23 20:27:10 user nova-compute[74429]:         <nova:port uuid="86c31d69-4b84-4dd9-a888-7f8df151244b">
Oct 23 20:27:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:27:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:27:10 user nova-compute[74429]:       </nova:ports>
Oct 23 20:27:10 user nova-compute[74429]:     </nova:instance>
Oct 23 20:27:10 user nova-compute[74429]:   </metadata>
Oct 23 20:27:10 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:27:10 user nova-compute[74429]:     <system>
Oct 23 20:27:10 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:27:10 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:27:10 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:27:10 user nova-compute[74429]:       <entry name="serial">5c7005a2-402e-46c5-be64-9978443cdf0d</entry>
Oct 23 20:27:10 user nova-compute[74429]:       <entry name="uuid">5c7005a2-402e-46c5-be64-9978443cdf0d</entry>
Oct 23 20:27:10 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:27:10 user nova-compute[74429]:     </system>
Oct 23 20:27:10 user nova-compute[74429]:   </sysinfo>
Oct 23 20:27:10 user nova-compute[74429]:   <os>
Oct 23 20:27:10 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:27:10 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:27:10 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:27:10 user nova-compute[74429]:   </os>
Oct 23 20:27:10 user nova-compute[74429]:   <features>
Oct 23 20:27:10 user nova-compute[74429]:     <acpi/>
Oct 23 20:27:10 user nova-compute[74429]:     <apic/>
Oct 23 20:27:10 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:27:10 user nova-compute[74429]:   </features>
Oct 23 20:27:10 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:27:10 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:27:10 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:27:10 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:27:10 user nova-compute[74429]:   </clock>
Oct 23 20:27:10 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:27:10 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:27:10 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:27:10 user nova-compute[74429]:   </cpu>
Oct 23 20:27:10 user nova-compute[74429]:   <devices>
Oct 23 20:27:10 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:27:10 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:27:10 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk"/>
Oct 23 20:27:10 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:27:10 user nova-compute[74429]:     </disk>
Oct 23 20:27:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:27:10 user nova-compute[74429]:       <mac address="fa:16:3e:b2:b9:97"/>
Oct 23 20:27:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:27:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:27:10 user nova-compute[74429]:       <target dev="tap86c31d69-4b"/>
Oct 23 20:27:10 user nova-compute[74429]:     </interface>
Oct 23 20:27:10 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:27:10 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/console.log" append="off"/>
Oct 23 20:27:10 user nova-compute[74429]:     </serial>
Oct 23 20:27:10 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:27:10 user nova-compute[74429]:     <video>
Oct 23 20:27:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:27:10 user nova-compute[74429]:     </video>
Oct 23 20:27:10 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:27:10 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:27:10 user nova-compute[74429]:     </rng>
Oct 23 20:27:10 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:27:10 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:27:10 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:27:10 user nova-compute[74429]:     </memballoon>
Oct 23 20:27:10 user nova-compute[74429]:   </devices>
Oct 23 20:27:10 user nova-compute[74429]: </domain>
Oct 23 20:27:10 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1036379341',display_name='tempest-AttachVolumeNegativeTest-server-1036379341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1036379341',id=40,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOA6RmvZDj9ggNHxyuiZZFDD90Yd+w/6TEuR+TJyGjFjO5qn+e7WDwB6eCZ7CkMBvaXdflu5qYuQFeNu5nHVGSS+KvesQVATPj6+sBlkGrrF8VBrqIQBUVqV/Vxgn9KOw==',key_name='tempest-keypair-1312615786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-jikhtxh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=5c7005a2-402e-46c5-be64-9978443cdf0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG os_vif [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f060d0bd-209d-5069-be56-c039facd1f01', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86c31d69-4b, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86c31d69-4b, col_values=(('qos', UUID('47d6f502-cc6d-48bf-949b-489d9c1a0b53')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86c31d69-4b, col_values=(('external_ids', {'iface-id': '86c31d69-4b84-4dd9-a888-7f8df151244b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:b9:97', 'vm-uuid': '5c7005a2-402e-46c5-be64-9978443cdf0d'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:27:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:10 user nova-compute[74429]: INFO os_vif [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b')
Oct 23 20:27:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:27:11 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:b2:b9:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:27:11 user nova-compute[74429]: DEBUG nova.network.neutron [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updated VIF entry in instance network info cache for port 86c31d69-4b84-4dd9-a888-7f8df151244b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:27:11 user nova-compute[74429]: DEBUG nova.network.neutron [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating instance_info_cache with network_info: [{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-821168ef-a5c9-431b-99aa-7edf921820ac req-dce807f6-4532-4c3e-9b4f-a3bf3d69d05d service nova] Releasing lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-b59d44c2-0dc4-4526-8971-ede1ba1379f2 req-356a8706-44f0-45d0-bb8c-c471de070053 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b59d44c2-0dc4-4526-8971-ede1ba1379f2 req-356a8706-44f0-45d0-bb8c-c471de070053 service nova] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b59d44c2-0dc4-4526-8971-ede1ba1379f2 req-356a8706-44f0-45d0-bb8c-c471de070053 service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b59d44c2-0dc4-4526-8971-ede1ba1379f2 req-356a8706-44f0-45d0-bb8c-c471de070053 service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:12 user nova-compute[74429]: DEBUG nova.compute.manager [req-b59d44c2-0dc4-4526-8971-ede1ba1379f2 req-356a8706-44f0-45d0-bb8c-c471de070053 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] No waiting events found dispatching network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:27:12 user nova-compute[74429]: WARNING nova.compute.manager [req-b59d44c2-0dc4-4526-8971-ede1ba1379f2 req-356a8706-44f0-45d0-bb8c-c471de070053 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received unexpected event network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b for instance with vm_state building and task_state spawning.
Oct 23 20:27:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:27:14 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Instance spawned successfully.
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab63ab17-5a29-4b12-84c6-8e8334f3bffa req-6abfa3d7-102a-4100-9b23-ab71c9cbd55c service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab63ab17-5a29-4b12-84c6-8e8334f3bffa req-6abfa3d7-102a-4100-9b23-ab71c9cbd55c service nova] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab63ab17-5a29-4b12-84c6-8e8334f3bffa req-6abfa3d7-102a-4100-9b23-ab71c9cbd55c service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab63ab17-5a29-4b12-84c6-8e8334f3bffa req-6abfa3d7-102a-4100-9b23-ab71c9cbd55c service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab63ab17-5a29-4b12-84c6-8e8334f3bffa req-6abfa3d7-102a-4100-9b23-ab71c9cbd55c service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] No waiting events found dispatching network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:27:14 user nova-compute[74429]: WARNING nova.compute.manager [req-ab63ab17-5a29-4b12-84c6-8e8334f3bffa req-6abfa3d7-102a-4100-9b23-ab71c9cbd55c service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received unexpected event network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b for instance with vm_state building and task_state spawning.
Oct 23 20:27:14 user nova-compute[74429]: INFO nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Took 5.31 seconds to spawn the instance on the hypervisor.
Oct 23 20:27:14 user nova-compute[74429]: DEBUG nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:27:14 user nova-compute[74429]: INFO nova.compute.manager [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Took 6.03 seconds to build instance.
Oct 23 20:27:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-cc1a7437-b58a-4643-a9e2-64ebc08ff142 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.139s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-changed-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:16 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Refreshing instance network info cache due to event network-changed-22896824-ac74-4896-95ba-4e15adf3956d. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:27:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] Acquiring lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] Acquired lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:16 user nova-compute[74429]: DEBUG nova.network.neutron [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Refreshing network info cache for port 22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:27:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updated VIF entry in instance network info cache for port 22896824-ac74-4896-95ba-4e15adf3956d. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:27:17 user nova-compute[74429]: DEBUG nova.network.neutron [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating instance_info_cache with network_info: [{"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ab87458a-237f-4d12-89cb-624a3cdeef59 req-2cf5916b-4ab4-4536-87c6-85f2ac17c04d service nova] Releasing lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG nova.objects.instance [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'flavor' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:18 user nova-compute[74429]: INFO nova.compute.manager [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attaching volume 3e5ff331-a526-4fc6-a980-a22c1584b963 to /dev/vdb
Oct 23 20:27:18 user nova-compute[74429]: DEBUG os_brick.utils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[091d6a65-4bd2-4f0f-9bbb-6ebd79289157]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565bfb4-7a23-4ba3-aa17-36de9294e7be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909642a-397b-4c31-888a-5a76aa843afd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[93094357-fdfa-441e-a38a-4b0127aa5a36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:18 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:27:18 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[93764fd9-b33a-4856-bab9-d0000a8d9da2]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG os_brick.utils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:27:18 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating existing volume attachment record: 5cd37202-9264-489c-8f3c-aafb874ff897 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:27:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:27:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:35 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8222MB free_disk=25.192237854003906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:35 user nova-compute[74429]: INFO nova.compute.manager [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attaching volume 94737145-c659-4f9e-814d-b4f64a0b1311 to /dev/vdb
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.utils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a28e51-a12c-4750-83aa-9f2645f54899]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2502b26f-9ab8-4045-b840-0732bd0cd7e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2518683a-1e9b-4b01-9016-926336496b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5c7005a2-402e-46c5-be64-9978443cdf0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[676d634f-743f-4070-a9e8-f994841f8ff4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[437f4ee5-6814-4c62-bf01-b9801dc15496]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:35 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4094048-f9f3-47f1-84ed-4fdbea3dc625]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.utils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating existing volume attachment record: afdce145-7808-40b1-ae5f-d143d86daf47 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdKNTvAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:27:35 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:27:35 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:27:35 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78ac28-18f0-474e-94b8-af9082ce98a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:27:35 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00e7d64-17a2-42b4-a927-4906b0bde6d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963] added
Oct 23 20:27:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[51571ac4-a57d-428d-8dce-b0bb189615d4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3777f495-9297-40d9-a20e-162a38f91963]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdKNTvAz {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdKNTvAz" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1865644-828d-4152-be32-30637840883b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jdKNTvAz'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[437bd840-d180-4eb2-a941-9b623caf4c6a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec93ae6c-1f86-4e01-b918-634f71fadaf4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:27:36 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:27:36 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:27:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:27:36 user nova-compute[74429]: 
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db8e9a-ca79-4fad-bb9f-fc7b2057a972]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260]
Oct 23 20:27:36 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260] successful.
Oct 23 20:27:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c4c57-61bf-434e-99c4-0b6eeedfc11c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c434a66-531b-4808-ae2d-c52e1720ec6e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:27:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:27:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a3394-8d65-470a-9e0f-cd512f984daa]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdKNTvAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26436383265383464', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436383265383464', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG nova.objects.instance [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'flavor' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:27:37 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:27:37 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:27:37 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:27:37 user nova-compute[74429]:   <serial>3e5ff331-a526-4fc6-a980-a22c1584b963</serial>
Oct 23 20:27:37 user nova-compute[74429]: </disk>
Oct 23 20:27:37 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No VIF found with MAC fa:16:3e:8c:38:3c, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:27:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-5d813606-de53-4a3e-af96-8ce0931181d4 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.198s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:27:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating instance_info_cache with network_info: [{"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-81531119-0cca-4cf3-9cfc-113587c2c786" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:27:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG nova.objects.instance [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'flavor' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:41 user nova-compute[74429]: INFO nova.compute.manager [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attaching volume de111d03-4b45-4dbb-8886-514eac81a005 to /dev/vdc
Oct 23 20:27:41 user nova-compute[74429]: DEBUG os_brick.utils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[836bebe7-f75c-4e0d-9120-a36825f8e40d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef702e-9fbd-411f-b34d-7296eeeec105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54fe288-1a49-4045-b865-75b64335708c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8eb3ba-45c6-41db-b64b-2523d46822cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:41 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:27:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc810409-6765-4c31-9a6d-928685c4fe85]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG os_brick.utils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:27:41 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating existing volume attachment record: 100ff48d-19bf-44d8-9308-ddbd8a4e0e5d {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:42 user nova-compute[74429]: INFO nova.compute.manager [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Terminating instance
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "581e7447-603c-49ce-90e3-be01d76865f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:27:42 user nova-compute[74429]: INFO nova.compute.claims [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Claim successful on node user
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-b806ed6e-754e-4ae4-941c-66e36ef3af61 req-70b5d4ee-27cb-4495-b0db-ba9a81566f54 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-vif-unplugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b806ed6e-754e-4ae4-941c-66e36ef3af61 req-70b5d4ee-27cb-4495-b0db-ba9a81566f54 service nova] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b806ed6e-754e-4ae4-941c-66e36ef3af61 req-70b5d4ee-27cb-4495-b0db-ba9a81566f54 service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b806ed6e-754e-4ae4-941c-66e36ef3af61 req-70b5d4ee-27cb-4495-b0db-ba9a81566f54 service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-b806ed6e-754e-4ae4-941c-66e36ef3af61 req-70b5d4ee-27cb-4495-b0db-ba9a81566f54 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] No waiting events found dispatching network-vif-unplugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-b806ed6e-754e-4ae4-941c-66e36ef3af61 req-70b5d4ee-27cb-4495-b0db-ba9a81566f54 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-vif-unplugged-b4a86429-c271-4070-a52e-169578098cce for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:27:42 user nova-compute[74429]: DEBUG nova.network.neutron [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.policy [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8399a03e24cd4cd7bbd8bdd9558d0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827ab59e22b4fa69f1475517e89727a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.virt.block_device [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Booting with volume b9c809d5-d448-4f96-8060-382c654e8799 at /dev/vda
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Instance destroyed successfully.
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.objects.instance [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lazy-loading 'resources' on Instance uuid 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_brick.utils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1457422084',display_name='tempest-VolumesActionsTest-instance-1457422084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1457422084',id=38,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bf265c64a1d42d7bbc7afd948fa1feb',ramdisk_id='',reservation_id='r-4n1jse49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-805266683',owner_user_name='tempest-VolumesActionsTest-805266683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:25:58Z,user_data=None,user_id='8220ac323e7245e69a908f2cb9405cf0',uuid=3bc2c33f-debb-43c3-937b-cd8d41ba9cd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converting VIF {"id": "b4a86429-c271-4070-a52e-169578098cce", "address": "fa:16:3e:f7:67:fd", "network": {"id": "4b3df2d4-822a-4177-9602-899bf52766f0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463873345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bf265c64a1d42d7bbc7afd948fa1feb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a86429-c2", "ovs_interfaceid": "b4a86429-c271-4070-a52e-169578098cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_vif [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4a86429-c2, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8182d42f-7803-4ea3-af81-fc946a3c2eba) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e29a91-0fad-4593-95a4-6547723f8939]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:43 user nova-compute[74429]: INFO os_vif [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=b4a86429-c271-4070-a52e-169578098cce,network=Network(4b3df2d4-822a-4177-9602-899bf52766f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a86429-c2')
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Deleting instance files /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2_del
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Deletion of /opt/stack/data/nova/instances/3bc2c33f-debb-43c3-937b-cd8d41ba9cd2_del complete
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae86afe-a9c8-4138-b72a-8bc173b5efb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168bd55-c1d8-4b37-9a0e-eec300b9b224]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf7bd0a-7f8c-4b69-b817-f921a29949c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.compute.manager [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:27:43 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb37c2b-6ce5-4bd6-8ec3-a4aae3f0c388]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG os_brick.utils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updating existing volume attachment record: b79c1363-b257-4d83-a3e3-f4b960883dc8 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Successfully created port: a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:43 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Took 0.49 seconds to deallocate network for instance.
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-77b1f7cc-62ea-4156-85db-56876950ccbd req-35862cd2-3e37-44d2-a0b0-1b96b4374a3f service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-vif-deleted-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:44 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Deleted allocations for instance 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-71fa6999-1131-4c5e-a60d-616a0c811b1e tempest-VolumesActionsTest-805266683 tempest-VolumesActionsTest-805266683-project-member] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Successfully updated port: a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquired lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updating instance_info_cache with network_info: [{"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Releasing lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Instance network_info: |[{"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received event network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] Acquiring lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] Lock "3bc2c33f-debb-43c3-937b-cd8d41ba9cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] No waiting events found dispatching network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:27:44 user nova-compute[74429]: WARNING nova.compute.manager [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 3bc2c33f-debb-43c3-937b-cd8d41ba9cd2] Received unexpected event network-vif-plugged-b4a86429-c271-4070-a52e-169578098cce for instance with vm_state deleted and task_state None.
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-changed-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Refreshing instance network info cache due to event network-changed-a5709450-110b-4f25-ac6f-0653bf54fdc8. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] Acquiring lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] Acquired lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:27:44 user nova-compute[74429]: DEBUG nova.network.neutron [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Refreshing network info cache for port a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:27:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updated VIF entry in instance network info cache for port a5709450-110b-4f25-ac6f-0653bf54fdc8. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:27:45 user nova-compute[74429]: DEBUG nova.network.neutron [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updating instance_info_cache with network_info: [{"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:27:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-33a4f4bc-c730-427b-b240-0bc947999b74 req-e1c35a53-e26e-4e0c-80ff-492d78f66e45 service nova] Releasing lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:27:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:50 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:50 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:27:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:27:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:27:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:27:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:27:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:27:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Creating image(s)
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Ensure instance console log exists: /opt/stack/data/nova/instances/581e7447-603c-49ce-90e3-be01d76865f0/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Start _get_guest_xml network_info=[{"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b79c1363-b257-4d83-a3e3-f4b960883dc8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlMVePnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '581e7447-603c-49ce-90e3-be01d76865f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9c809d5-d448-4f96-8060-382c654e8799', 'serial': 'b9c809d5-d448-4f96-8060-382c654e8799'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:27:59 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:59 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:27:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlMVePnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:28:00 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:00 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:00 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c0d7a0-dc4c-482b-876c-308506bd0da4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:28:00 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5014568e-2a74-492f-9a35-b36e672c8739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799] added
Oct 23 20:28:00 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdac6eb-80d6-4076-9b70-6b3f102d0efd]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a36456-e5c3-4c03-b31a-d9e681a335a9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlMVePnL {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlMVePnL" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb42650-39d3-4f1b-b5e9-0803332b0d12]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlMVePnL'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9558e8-d0cb-4199-9491-e54aa1d3216a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[61adec4f-957e-4658-9577-b8ab9b75d3bc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:00 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:00 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a214e32-e04e-4119-9e6d-103ee7814e0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260]
Oct 23 20:28:00 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260] successful.
Oct 23 20:28:00 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d8975a-53d9-4c77-aa8b-c51a609abf94]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ece8b3-cbc3-4010-ad7e-17284aaa3155]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:00 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:00 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:00 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:00 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c85f5c-d8e0-4d27-9fba-6660c62ef43c]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:00 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlMVePnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23363356434393963', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363356434393963', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1297130464',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1297130464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1297130464',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRXue/H6nlj0pESviC/pDL3VuiyO605fhhQct05/nqkc/ABxrfPolbEkkZXc1qKEophrYcSiXw6fA0sVXysk3F33QSa5kAzofzAQe7JLJV+JLRBI+HjUvA5UNAjPMrXFw==',key_name='tempest-keypair-1883712077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-qflbpcqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=581e7447-603c-49ce-90e3-be01d76865f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.objects.instance [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'pci_devices' on Instance uuid 581e7447-603c-49ce-90e3-be01d76865f0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:28:01 user nova-compute[74429]:   <uuid>581e7447-603c-49ce-90e3-be01d76865f0</uuid>
Oct 23 20:28:01 user nova-compute[74429]:   <name>instance-00000029</name>
Oct 23 20:28:01 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:28:01 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:28:01 user nova-compute[74429]:   <metadata>
Oct 23 20:28:01 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:28:01 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:28:01 user nova-compute[74429]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1297130464</nova:name>
Oct 23 20:28:01 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:27:59</nova:creationTime>
Oct 23 20:28:01 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:28:01 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:28:01 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:28:01 user nova-compute[74429]:       <nova:owner>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:user uuid="8399a03e24cd4cd7bbd8bdd9558d0798">tempest-TestVolumeBootPattern-2072234131-project-member</nova:user>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:project uuid="6827ab59e22b4fa69f1475517e89727a">tempest-TestVolumeBootPattern-2072234131</nova:project>
Oct 23 20:28:01 user nova-compute[74429]:       </nova:owner>
Oct 23 20:28:01 user nova-compute[74429]:       <nova:ports>
Oct 23 20:28:01 user nova-compute[74429]:         <nova:port uuid="a5709450-110b-4f25-ac6f-0653bf54fdc8">
Oct 23 20:28:01 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:28:01 user nova-compute[74429]:         </nova:port>
Oct 23 20:28:01 user nova-compute[74429]:       </nova:ports>
Oct 23 20:28:01 user nova-compute[74429]:     </nova:instance>
Oct 23 20:28:01 user nova-compute[74429]:   </metadata>
Oct 23 20:28:01 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:28:01 user nova-compute[74429]:     <system>
Oct 23 20:28:01 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:28:01 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:28:01 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:28:01 user nova-compute[74429]:       <entry name="serial">581e7447-603c-49ce-90e3-be01d76865f0</entry>
Oct 23 20:28:01 user nova-compute[74429]:       <entry name="uuid">581e7447-603c-49ce-90e3-be01d76865f0</entry>
Oct 23 20:28:01 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:28:01 user nova-compute[74429]:     </system>
Oct 23 20:28:01 user nova-compute[74429]:   </sysinfo>
Oct 23 20:28:01 user nova-compute[74429]:   <os>
Oct 23 20:28:01 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:28:01 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:28:01 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:28:01 user nova-compute[74429]:   </os>
Oct 23 20:28:01 user nova-compute[74429]:   <features>
Oct 23 20:28:01 user nova-compute[74429]:     <acpi/>
Oct 23 20:28:01 user nova-compute[74429]:     <apic/>
Oct 23 20:28:01 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:28:01 user nova-compute[74429]:   </features>
Oct 23 20:28:01 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:28:01 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:28:01 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:28:01 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:28:01 user nova-compute[74429]:   </clock>
Oct 23 20:28:01 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:28:01 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:28:01 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:28:01 user nova-compute[74429]:   </cpu>
Oct 23 20:28:01 user nova-compute[74429]:   <devices>
Oct 23 20:28:01 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:28:01 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:01 user nova-compute[74429]:       <source dev="/dev/sdc"/>
Oct 23 20:28:01 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:28:01 user nova-compute[74429]:       <serial>b9c809d5-d448-4f96-8060-382c654e8799</serial>
Oct 23 20:28:01 user nova-compute[74429]:     </disk>
Oct 23 20:28:01 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:28:01 user nova-compute[74429]:       <mac address="fa:16:3e:27:1f:fe"/>
Oct 23 20:28:01 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:28:01 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:28:01 user nova-compute[74429]:       <target dev="tapa5709450-11"/>
Oct 23 20:28:01 user nova-compute[74429]:     </interface>
Oct 23 20:28:01 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:28:01 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/581e7447-603c-49ce-90e3-be01d76865f0/console.log" append="off"/>
Oct 23 20:28:01 user nova-compute[74429]:     </serial>
Oct 23 20:28:01 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:28:01 user nova-compute[74429]:     <video>
Oct 23 20:28:01 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:28:01 user nova-compute[74429]:     </video>
Oct 23 20:28:01 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:28:01 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:28:01 user nova-compute[74429]:     </rng>
Oct 23 20:28:01 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:28:01 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:28:01 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:28:01 user nova-compute[74429]:     </memballoon>
Oct 23 20:28:01 user nova-compute[74429]:   </devices>
Oct 23 20:28:01 user nova-compute[74429]: </domain>
Oct 23 20:28:01 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1297130464',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1297130464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1297130464',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRXue/H6nlj0pESviC/pDL3VuiyO605fhhQct05/nqkc/ABxrfPolbEkkZXc1qKEophrYcSiXw6fA0sVXysk3F33QSa5kAzofzAQe7JLJV+JLRBI+HjUvA5UNAjPMrXFw==',key_name='tempest-keypair-1883712077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-qflbpcqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=581e7447-603c-49ce-90e3-be01d76865f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG os_vif [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48a8161e-ea50-5b88-b37e-9051159d1ac3', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5709450-11, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5709450-11, col_values=(('qos', UUID('bd2c2016-db57-4421-ad76-0dcc640a0a3f')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5709450-11, col_values=(('external_ids', {'iface-id': 'a5709450-110b-4f25-ac6f-0653bf54fdc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:1f:fe', 'vm-uuid': '581e7447-603c-49ce-90e3-be01d76865f0'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:01 user nova-compute[74429]: INFO os_vif [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11')
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:28:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No VIF found with MAC fa:16:3e:27:1f:fe, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-9b380879-cea6-4780-831b-10b8e33ad8be req-856d6cc3-5190-42a6-acd1-f04ad460bc30 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9b380879-cea6-4780-831b-10b8e33ad8be req-856d6cc3-5190-42a6-acd1-f04ad460bc30 service nova] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9b380879-cea6-4780-831b-10b8e33ad8be req-856d6cc3-5190-42a6-acd1-f04ad460bc30 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9b380879-cea6-4780-831b-10b8e33ad8be req-856d6cc3-5190-42a6-acd1-f04ad460bc30 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-9b380879-cea6-4780-831b-10b8e33ad8be req-856d6cc3-5190-42a6-acd1-f04ad460bc30 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] No waiting events found dispatching network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:28:02 user nova-compute[74429]: WARNING nova.compute.manager [req-9b380879-cea6-4780-831b-10b8e33ad8be req-856d6cc3-5190-42a6-acd1-f04ad460bc30 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received unexpected event network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 for instance with vm_state building and task_state spawning.
Oct 23 20:28:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:28:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Instance spawned successfully.
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:28:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:28:05 user nova-compute[74429]: INFO nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Took 5.04 seconds to spawn the instance on the hypervisor.
Oct 23 20:28:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:28:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-48f7d530-c7ea-4d6d-a11b-c972ed8c543b req-4acfe9bd-3c72-4b1f-a89a-ad215d0ec7b3 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:28:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-48f7d530-c7ea-4d6d-a11b-c972ed8c543b req-4acfe9bd-3c72-4b1f-a89a-ad215d0ec7b3 service nova] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-48f7d530-c7ea-4d6d-a11b-c972ed8c543b req-4acfe9bd-3c72-4b1f-a89a-ad215d0ec7b3 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-48f7d530-c7ea-4d6d-a11b-c972ed8c543b req-4acfe9bd-3c72-4b1f-a89a-ad215d0ec7b3 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-48f7d530-c7ea-4d6d-a11b-c972ed8c543b req-4acfe9bd-3c72-4b1f-a89a-ad215d0ec7b3 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] No waiting events found dispatching network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:28:05 user nova-compute[74429]: WARNING nova.compute.manager [req-48f7d530-c7ea-4d6d-a11b-c972ed8c543b req-4acfe9bd-3c72-4b1f-a89a-ad215d0ec7b3 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received unexpected event network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 for instance with vm_state building and task_state spawning.
Oct 23 20:28:05 user nova-compute[74429]: INFO nova.compute.manager [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Took 22.57 seconds to build instance.
Oct 23 20:28:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-54a2ed8a-b91c-4672-9075-d5a1ee55ac25 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "581e7447-603c-49ce-90e3-be01d76865f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.688s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxyogXmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:28:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:12 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ed4fd-c893-4a5d-ac1b-36c63162a06b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:28:12 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f867d3-0c76-4fb4-bedc-ab6f0b6018d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311] added
Oct 23 20:28:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnASUZMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:28:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0405b7-6fcd-4733-9200-84619272b54a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca652add-ae13-4b42-a812-1cc5901db907]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxyogXmz {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxyogXmz" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22ecefa-57a3-44d5-be52-b4db2b89b3ab]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CxyogXmz'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3470caa2-9fc6-47cb-8948-0749302ab17e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f707a-4ee2-44ec-9a5d-e3ac017f45df]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda79c5-dc78-4fa6-886c-0ce9d9948034]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260]
Oct 23 20:28:12 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260] successful.
Oct 23 20:28:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d5477-c961-4a7c-98b0-a993e24e6869]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6c5413-9291-4caf-9e5c-fabdde4d6eb8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8076a7-5bbe-44fb-ba83-747fec8d8f18]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:28:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxyogXmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23762363836653639', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363836653639', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.265s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:13 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:13 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de63511e-a1fe-4c7d-bcc6-269ae33ec646]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:28:13 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:28:13 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:13 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:28:13 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:28:13 user nova-compute[74429]:   <serial>94737145-c659-4f9e-814d-b4f64a0b1311</serial>
Oct 23 20:28:13 user nova-compute[74429]: </disk>
Oct 23 20:28:13 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ac15f-1580-4f89-9519-dd549285c4c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005] added
Oct 23 20:28:13 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605d50d-1bdf-4594-83d0-e70fa1b85750]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[75967eaa-64ef-4f80-8b07-425c80a2a0e6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnASUZMK {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnASUZMK" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb53b308-f4f8-414a-b87a-17119d76e990]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DnASUZMK'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a69fe-57a6-48fc-a9c1-9bfb9f6a0aae]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01defb8-781b-465a-876d-16ead2055663]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7702357-3c77-4507-a775-620d68b3df81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260]
Oct 23 20:28:14 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260] successful.
Oct 23 20:28:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd601ce8-b74b-4066-b3ec-634ea07777ab]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4957c5b-7975-4290-b6e2-1f583f782ba0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 (non-flash)
Oct 23 20:28:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c204311-28d6-4097-b62c-ba848664cc1d]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnASUZMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] No VIF found with MAC fa:16:3e:3d:22:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:28:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e8a4e262-ce18-420e-97f5-ee302da2c65d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.191s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] <== connect_volume: return (2583ms) {'type': 'block', 'scsi_wwn': '23364343762386438', 'path': '/dev/sde'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364343762386438', 'path': '/dev/sde'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.objects.instance [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'flavor' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:28:15 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:15 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:28:15 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:28:15 user nova-compute[74429]:   <serial>de111d03-4b45-4dbb-8886-514eac81a005</serial>
Oct 23 20:28:15 user nova-compute[74429]: </disk>
Oct 23 20:28:15 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] No VIF found with MAC fa:16:3e:8c:38:3c, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:28:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-39ec2489-cd59-4302-8103-675fa29c0774 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.236s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:16 user nova-compute[74429]: INFO nova.compute.manager [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Detaching volume de111d03-4b45-4dbb-8886-514eac81a005
Oct 23 20:28:16 user nova-compute[74429]: INFO nova.virt.block_device [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attempting to driver detach volume de111d03-4b45-4dbb-8886-514eac81a005 from mountpoint /dev/vdc
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Attempting to detach device vdc from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:28:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:16 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:28:16 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:28:16 user nova-compute[74429]:   <serial>de111d03-4b45-4dbb-8886-514eac81a005</serial>
Oct 23 20:28:16 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 20:28:16 user nova-compute[74429]: </disk>
Oct 23 20:28:16 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:28:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Successfully detached device vdc from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the persistent domain config.
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:28:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:16 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:28:16 user nova-compute[74429]:   <target dev="vdc" bus="virtio"/>
Oct 23 20:28:16 user nova-compute[74429]:   <serial>de111d03-4b45-4dbb-8886-514eac81a005</serial>
Oct 23 20:28:16 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 20:28:16 user nova-compute[74429]: </disk>
Oct 23 20:28:16 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:28:16 user nova-compute[74429]: INFO nova.compute.manager [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Detaching volume 94737145-c659-4f9e-814d-b4f64a0b1311
Oct 23 20:28:16 user nova-compute[74429]: INFO nova.virt.block_device [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Attempting to driver detach volume 94737145-c659-4f9e-814d-b4f64a0b1311 from mountpoint /dev/vdb
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Attempting to detach device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:28:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:16 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:28:16 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:28:16 user nova-compute[74429]:   <serial>94737145-c659-4f9e-814d-b4f64a0b1311</serial>
Oct 23 20:28:16 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:28:16 user nova-compute[74429]: </disk>
Oct 23 20:28:16 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:28:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the persistent domain config.
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:28:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:28:16 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:28:16 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:28:16 user nova-compute[74429]:   <serial>94737145-c659-4f9e-814d-b4f64a0b1311</serial>
Oct 23 20:28:16 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:28:16 user nova-compute[74429]: </disk>
Oct 23 20:28:16 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:28:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:28:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:28:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:28 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:32 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:28:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:28:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:28:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8225MB free_disk=25.215084075927734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2518683a-1e9b-4b01-9016-926336496b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5c7005a2-402e-46c5-be64-9978443cdf0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 581e7447-603c-49ce-90e3-be01d76865f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:28:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:28:35 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:28:35 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:28:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:28:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:36 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 is timed out.
Oct 23 20:28:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Successfully detached device vdc from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the live domain config.
Oct 23 20:28:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnASUZMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:28:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688b00c-83e1-4422-8875-3d4a932c07b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:28:36 user nova-compute[74429]: No targets found.
Oct 23 20:28:36 user nova-compute[74429]: iSNS:
Oct 23 20:28:36 user nova-compute[74429]: No targets found.
Oct 23 20:28:36 user nova-compute[74429]: STATIC:
Oct 23 20:28:36 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005
Oct 23 20:28:36 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:36 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:36 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963
Oct 23 20:28:36 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:36 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:36 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311
Oct 23 20:28:36 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:36 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:36 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:28:36 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:36 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:36 user nova-compute[74429]: FIRMWARE:
Oct 23 20:28:36 user nova-compute[74429]: No targets found.
Oct 23 20:28:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:28:36 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:28:36 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[725b4776-e520-460d-9139-832c4952d7a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24237dd-98ee-48e3-9877-443772cedeaf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 (non-flash)
Oct 23 20:28:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50562290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005'): ({'sde'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Removing single pathed devices sde {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9768f06-cadd-45e7-8718-266f84d0c7f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3813be3d-1539-44e7-8dd0-c728f49cbdae]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Flushing IO for device /dev/sde {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[691c72f6-4e42-49d3-8aae-04e2efcff144]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:28:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e707a83b-3bc2-471b-a6da-420012f44cf8]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea9235-249b-44b4-850f-99fbc12be2c1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81531119-0cca-4cf3-9cfc-113587c2c786 is timed out.
Oct 23 20:28:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully detached device vdb from instance 81531119-0cca-4cf3-9cfc-113587c2c786 from the live domain config.
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxyogXmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:28:37 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[172ecd3c-228c-4f66-a446-407ed04d4c3f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260]
Oct 23 20:28:37 user nova-compute[74429]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005, portal: 172.16.0.220,3260] successful.
Oct 23 20:28:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de111d03-4b45-4dbb-8886-514eac81a005 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b700f-322c-4d18-860a-ddb9d2545f59]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] <== disconnect_volume: return (359ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.074s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f59e75-c3d1-4efa-b310-3e20dab5d844]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:28:37 user nova-compute[74429]: No targets found.
Oct 23 20:28:37 user nova-compute[74429]: iSNS:
Oct 23 20:28:37 user nova-compute[74429]: No targets found.
Oct 23 20:28:37 user nova-compute[74429]: STATIC:
Oct 23 20:28:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963
Oct 23 20:28:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311
Oct 23 20:28:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:28:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:28:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:28:37 user nova-compute[74429]: FIRMWARE:
Oct 23 20:28:37 user nova-compute[74429]: No targets found.
Oct 23 20:28:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:28:37 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:28:37 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b186f9-2c40-4949-be9f-59ac7f11cfb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d022cb72-94c4-4011-8692-e4a45fdf50ad]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:37 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:37 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:28:37 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:28:37 user nova-compute[74429]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 (non-flash)
Oct 23 20:28:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c6c85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ba4ad-a502-4f5c-af88-d272b9f93aba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dea635-df6d-439b-8fed-ff606ef4a8ca]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed67fa-3e5e-44e3-86d5-3356794af8ed]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74bd68c-44aa-4221-a2b3-e09fc757bf3b]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea010910-4d4b-4d7f-80f7-d6fb67746686]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b20466-31c5-48a7-8475-e85303503059]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260]
Oct 23 20:28:37 user nova-compute[74429]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311, portal: 172.16.0.220,3260] successful.
Oct 23 20:28:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94737145-c659-4f9e-814d-b4f64a0b1311 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b02d2-d932-4047-ae16-bc85aa2710d1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] <== disconnect_volume: return (416ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating instance_info_cache with network_info: [{"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:37 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'flavor' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:28:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-4b8d1fe7-2f53-4c75-8fe7-0267b5130d9b tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.054s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:38 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:28:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:28:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:28:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:28:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:28:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:28:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:28:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:28:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:28:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:28:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:28:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:28:52 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'flavor' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:28:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8c86a231-4834-44e5-aa72-8019e4f3a7b8 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.837s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'flavor' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:28:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:28:54 user nova-compute[74429]: INFO nova.compute.manager [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Attaching volume aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f to /dev/vdb
Oct 23 20:28:54 user nova-compute[74429]: DEBUG os_brick.utils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d867f66f-bc1d-4862-880a-89135e057fd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9f9d8-a9c5-4209-8007-ab02c9b8f130]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d1071-365d-4d99-b661-4c3c05854415]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ade64-c993-46e6-acab-c5da58e470ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:28:54 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:28:54 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510ebc9-4c4b-47d5-90e8-7e327bfc496c]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG os_brick.utils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:28:54 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating existing volume attachment record: fcceaf0a-4f9b-4367-afd6-f17f9e8722df {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:28:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-changed-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Refreshing instance network info cache due to event network-changed-86c31d69-4b84-4dd9-a888-7f8df151244b. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] Acquiring lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] Acquired lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Refreshing network info cache for port 86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updated VIF entry in instance network info cache for port 86c31d69-4b84-4dd9-a888-7f8df151244b. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating instance_info_cache with network_info: [{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-17f0327a-8097-4262-b8bf-b62091ea52d1 req-9a99572d-49f4-48fd-9f87-3b2838c3a352 service nova] Releasing lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid 5c7005a2-402e-46c5-be64-9978443cdf0d {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.244s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:07 user nova-compute[74429]: INFO nova.compute.manager [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Attaching volume 560de346-d33e-4d72-9db7-06815574dfbc to /dev/vdb
Oct 23 20:29:07 user nova-compute[74429]: DEBUG os_brick.utils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c346bf1-8f48-4925-a1e0-c5c5fe30ce12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.073s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf00a58-cacf-4b26-b01f-3c15521486de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[827197eb-54ac-418a-8a4f-ac68823fbef2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e238803-698a-4e58-9bb3-3299e8ebbafe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:29:07 user nova-compute[74429]: INFO nova.compute.manager [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Detaching volume 3e5ff331-a526-4fc6-a980-a22c1584b963
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:29:07 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:29:07 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a4d23-c092-45c8-ade4-6275c0732ff4]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG os_brick.utils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== get_connector_properties: return (254ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating existing volume attachment record: d4a3cc9c-9560-412e-91c9-edff9f4f7011 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:29:07 user nova-compute[74429]: INFO nova.virt.block_device [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Attempting to driver detach volume 3e5ff331-a526-4fc6-a980-a22c1584b963 from mountpoint /dev/vdb
Oct 23 20:29:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Attempting to detach device vdb from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:29:07 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:29:07 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:29:07 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:29:07 user nova-compute[74429]:   <serial>3e5ff331-a526-4fc6-a980-a22c1584b963</serial>
Oct 23 20:29:07 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:29:07 user nova-compute[74429]: </disk>
Oct 23 20:29:07 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:29:07 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Successfully detached device vdb from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the persistent domain config.
Oct 23 20:29:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:29:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:29:07 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:29:07 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:29:07 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:29:07 user nova-compute[74429]:   <serial>3e5ff331-a526-4fc6-a980-a22c1584b963</serial>
Oct 23 20:29:07 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:29:07 user nova-compute[74429]: </disk>
Oct 23 20:29:07 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:29:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:29:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:29:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:12 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a59973-f676-48ab-9a68-f4f0eb1bfc19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:29:12 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.073s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2bdcd-3e62-4841-ba8c-703847c85b08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f] added
Oct 23 20:29:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b1bc23-e290-4faf-a288-02fce42192a1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[045303a5-5244-4634-961f-cebb88296c1f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuUJxLQB {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuUJxLQB" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e31a05-ae29-4d82-b6e2-f3820c3f37c9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuUJxLQB'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e622be2d-8b53-49b0-b1e1-1e148aa82747]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[14559c59-b9f1-4d61-aa7f-a25dabc93011]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec9b84-d559-4850-a2c2-f88c75a465b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]
Oct 23 20:29:12 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.
Oct 23 20:29:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3bc409-5b9b-488c-9587-d98f9fcc8273]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[edee4789-b1af-4c09-9579-59a2461eead0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:12 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6acbee5-a54c-499b-a1b2-7e45f40b2756]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23834636432663238', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834636432663238', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'flavor' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:29:13 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:29:13 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:29:13 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:29:13 user nova-compute[74429]:   <serial>aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f</serial>
Oct 23 20:29:13 user nova-compute[74429]: </disk>
Oct 23 20:29:13 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:29:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:29:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:29:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No VIF found with MAC fa:16:3e:9e:7a:d6, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:29:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0dc9c771-9756-45b5-8518-7b7986d7890e tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.462s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:29:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:29:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:29:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzNrhsjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:29:26 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:26 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:26 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa26b64-3ca1-4c15-b898-5256d4d36ffc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:29:26 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eace732-944d-4398-b26c-5cb8e3cd83de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc] added
Oct 23 20:29:26 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49b32a-24ac-4026-80ce-2d481f8725ba]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af93aa8-45d9-4102-b2cc-b789d7928d5e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzNrhsjf {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzNrhsjf" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f0bd94-7b1b-4aaf-bc9b-420111e4f91a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzNrhsjf'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf9bf33-7ced-407c-8da3-32774341ef1d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e860e39f-2023-4160-a5e1-5638bc413bf1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:26 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:26 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc33ccd-0768-4e35-85fd-ea1b7f8ad97b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260]
Oct 23 20:29:26 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260] successful.
Oct 23 20:29:26 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[50868265-565c-42d3-9658-340738673094]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9b0241-51b5-4953-a175-8144580fc134]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:26 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:26 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:26 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa92ea-5808-4c47-a53c-b15d192cb056]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:29:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzNrhsjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23166616463646265', 'path': '/dev/sde'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166616463646265', 'path': '/dev/sde'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG nova.objects.instance [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid 5c7005a2-402e-46c5-be64-9978443cdf0d {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:29:27 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:29:27 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:29:27 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:29:27 user nova-compute[74429]:   <serial>560de346-d33e-4d72-9db7-06815574dfbc</serial>
Oct 23 20:29:27 user nova-compute[74429]: </disk>
Oct 23 20:29:27 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:29:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:b2:b9:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-091f763c-598f-4f6d-a362-7ca9f707839f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.767s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing instance network info cache due to event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG nova.network.neutron [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:29:28 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 is timed out.
Oct 23 20:29:28 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Successfully detached device vdb from instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 from the live domain config.
Oct 23 20:29:28 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdKNTvAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:29:28 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[699936a2-4206-48fa-8c90-a6b7b5111223]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:29:28 user nova-compute[74429]: No targets found.
Oct 23 20:29:28 user nova-compute[74429]: iSNS:
Oct 23 20:29:28 user nova-compute[74429]: No targets found.
Oct 23 20:29:28 user nova-compute[74429]: STATIC:
Oct 23 20:29:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963
Oct 23 20:29:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:29:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f
Oct 23 20:29:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:28 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc
Oct 23 20:29:28 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:28 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:28 user nova-compute[74429]: FIRMWARE:
Oct 23 20:29:28 user nova-compute[74429]: No targets found.
Oct 23 20:29:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:29:28 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:29:28 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746b82f-0d86-4a61-9f97-a3a5a47f4670]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abbe86b-c706-44b5-9dbf-8de8258dd8a5]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:28 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:28 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:28 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 (non-flash)
Oct 23 20:29:28 user nova-compute[74429]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:28 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:28 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:28 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c58b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a47ed30-bdc8-43cc-8048-8e860427f140]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf17c954-3b32-4539-a611-8d8dba1e2b0f]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b54200-17d6-42a1-8559-e3abd94f0834]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6921989-051c-4f9e-8efb-e3c9bc9d3027]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7205601c-3e60-4fb2-9a75-a0b79566eb28]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:28 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad37413-8bd0-4cae-a331-4ece5cce8aff]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260]
Oct 23 20:29:29 user nova-compute[74429]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963, portal: 172.16.0.220,3260] successful.
Oct 23 20:29:29 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated VIF entry in instance network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e5ff331-a526-4fc6-a980-a22c1584b963 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da069d2-6897-40f6-8527-a121a2ee50c3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] <== disconnect_volume: return (365ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-085596e5-9799-4cc4-9235-89ce395c6e54 req-2b3795a1-6c3b-4077-a176-a55263b62895 service nova] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:29 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:30 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'flavor' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ff22cf55-cd9b-41dd-a8d7-aee7c4d541c2 tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.649s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.compute.manager [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing instance network info cache due to event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.network.neutron [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:29:31 user nova-compute[74429]: INFO nova.compute.claims [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Claim successful on node user
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.network.neutron [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated VIF entry in instance network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.network.neutron [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-52630743-5cb9-475a-8d5f-9a2f75ccab25 req-83e508c8-50ff-4f7e-9706-1b0e9c577384 service nova] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:31 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:29:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.policy [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0276e322764c476dae32a7972c7851fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3ab94102b4496082c15d4ec466eb0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:29:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Creating image(s)
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "/opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.217s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk 1073741824" returned: 0 in 0.056s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Successfully created port: 71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Cannot resize image /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Ensure instance console log exists: /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-changed-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Refreshing instance network info cache due to event network-changed-a5709450-110b-4f25-ac6f-0653bf54fdc8. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] Acquiring lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] Acquired lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Refreshing network info cache for port a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Successfully updated port: 71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquired lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-changed-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Refreshing instance network info cache due to event network-changed-71f3532e-c21b-4705-9812-b65f2daa2f17. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] Acquiring lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.neutron [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updating instance_info_cache with network_info: [{"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Releasing lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Instance network_info: |[{"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] Acquired lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Refreshing network info cache for port 71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Start _get_guest_xml network_info=[{"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:29:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:29:34 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updated VIF entry in instance network info cache for port a5709450-110b-4f25-ac6f-0653bf54fdc8. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updating instance_info_cache with network_info: [{"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1427631568',display_name='tempest-AttachVolumeNegativeTest-server-1427631568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1427631568',id=42,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTcayXUFFhkWiNMOthoGGfoS6ENCR/1tY/IzjPjWmiNtSqOx5a6FptTbQtDUXcmU8BWYyjQKNofoncJedSifFhbBZMGksgQVd+2b0HPKbmQ7ZfRplHthR0cZGlRlcqZvw==',key_name='tempest-keypair-974514577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-ktqxji7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=663ca7bc-4de5-4800-9d95-7a7d2f2826c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.objects.instance [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'pci_devices' on Instance uuid 663ca7bc-4de5-4800-9d95-7a7d2f2826c4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3f17e9cc-9938-4ec3-adf5-afd30fb49411 req-e93bfc09-bb2b-412c-bac7-26d410d03a7d service nova] Releasing lock "refresh_cache-581e7447-603c-49ce-90e3-be01d76865f0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:29:34 user nova-compute[74429]:   <uuid>663ca7bc-4de5-4800-9d95-7a7d2f2826c4</uuid>
Oct 23 20:29:34 user nova-compute[74429]:   <name>instance-0000002a</name>
Oct 23 20:29:34 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:29:34 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:29:34 user nova-compute[74429]:   <metadata>
Oct 23 20:29:34 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:29:34 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:29:34 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1427631568</nova:name>
Oct 23 20:29:34 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:29:34</nova:creationTime>
Oct 23 20:29:34 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:29:34 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:29:34 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:29:34 user nova-compute[74429]:       <nova:owner>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:user uuid="0276e322764c476dae32a7972c7851fd">tempest-AttachVolumeNegativeTest-1373844485-project-member</nova:user>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:project uuid="5e3ab94102b4496082c15d4ec466eb0f">tempest-AttachVolumeNegativeTest-1373844485</nova:project>
Oct 23 20:29:34 user nova-compute[74429]:       </nova:owner>
Oct 23 20:29:34 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:29:34 user nova-compute[74429]:       <nova:ports>
Oct 23 20:29:34 user nova-compute[74429]:         <nova:port uuid="71f3532e-c21b-4705-9812-b65f2daa2f17">
Oct 23 20:29:34 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 20:29:34 user nova-compute[74429]:         </nova:port>
Oct 23 20:29:34 user nova-compute[74429]:       </nova:ports>
Oct 23 20:29:34 user nova-compute[74429]:     </nova:instance>
Oct 23 20:29:34 user nova-compute[74429]:   </metadata>
Oct 23 20:29:34 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:29:34 user nova-compute[74429]:     <system>
Oct 23 20:29:34 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:29:34 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:29:34 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:29:34 user nova-compute[74429]:       <entry name="serial">663ca7bc-4de5-4800-9d95-7a7d2f2826c4</entry>
Oct 23 20:29:34 user nova-compute[74429]:       <entry name="uuid">663ca7bc-4de5-4800-9d95-7a7d2f2826c4</entry>
Oct 23 20:29:34 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:29:34 user nova-compute[74429]:     </system>
Oct 23 20:29:34 user nova-compute[74429]:   </sysinfo>
Oct 23 20:29:34 user nova-compute[74429]:   <os>
Oct 23 20:29:34 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:29:34 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:29:34 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:29:34 user nova-compute[74429]:   </os>
Oct 23 20:29:34 user nova-compute[74429]:   <features>
Oct 23 20:29:34 user nova-compute[74429]:     <acpi/>
Oct 23 20:29:34 user nova-compute[74429]:     <apic/>
Oct 23 20:29:34 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:29:34 user nova-compute[74429]:   </features>
Oct 23 20:29:34 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:29:34 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:29:34 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:29:34 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:29:34 user nova-compute[74429]:   </clock>
Oct 23 20:29:34 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:29:34 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:29:34 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:29:34 user nova-compute[74429]:   </cpu>
Oct 23 20:29:34 user nova-compute[74429]:   <devices>
Oct 23 20:29:34 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:29:34 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:29:34 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk"/>
Oct 23 20:29:34 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:29:34 user nova-compute[74429]:     </disk>
Oct 23 20:29:34 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:29:34 user nova-compute[74429]:       <mac address="fa:16:3e:49:38:44"/>
Oct 23 20:29:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:29:34 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:29:34 user nova-compute[74429]:       <target dev="tap71f3532e-c2"/>
Oct 23 20:29:34 user nova-compute[74429]:     </interface>
Oct 23 20:29:34 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:29:34 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/console.log" append="off"/>
Oct 23 20:29:34 user nova-compute[74429]:     </serial>
Oct 23 20:29:34 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:29:34 user nova-compute[74429]:     <video>
Oct 23 20:29:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:29:34 user nova-compute[74429]:     </video>
Oct 23 20:29:34 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:29:34 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:29:34 user nova-compute[74429]:     </rng>
Oct 23 20:29:34 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:29:34 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:29:34 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:29:34 user nova-compute[74429]:     </memballoon>
Oct 23 20:29:34 user nova-compute[74429]:   </devices>
Oct 23 20:29:34 user nova-compute[74429]: </domain>
Oct 23 20:29:34 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1427631568',display_name='tempest-AttachVolumeNegativeTest-server-1427631568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1427631568',id=42,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTcayXUFFhkWiNMOthoGGfoS6ENCR/1tY/IzjPjWmiNtSqOx5a6FptTbQtDUXcmU8BWYyjQKNofoncJedSifFhbBZMGksgQVd+2b0HPKbmQ7ZfRplHthR0cZGlRlcqZvw==',key_name='tempest-keypair-974514577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-ktqxji7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=663ca7bc-4de5-4800-9d95-7a7d2f2826c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG os_vif [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0be7b64a-1e4c-5bf2-ba0f-047c41c5f69c', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71f3532e-c2, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71f3532e-c2, col_values=(('qos', UUID('08b30f2f-8dd1-4237-98b2-32fbee2bda4e')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71f3532e-c2, col_values=(('external_ids', {'iface-id': '71f3532e-c21b-4705-9812-b65f2daa2f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:38:44', 'vm-uuid': '663ca7bc-4de5-4800-9d95-7a7d2f2826c4'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:34 user nova-compute[74429]: INFO os_vif [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2')
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:49:38:44, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updated VIF entry in instance network info cache for port 71f3532e-c21b-4705-9812-b65f2daa2f17. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.network.neutron [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updating instance_info_cache with network_info: [{"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-66b0e04c-2603-45aa-af38-214dfe9e7c24 req-e417450a-885f-437c-92e3-470075c4b01d service nova] Releasing lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:29:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-1adcab79-2714-4990-b2ed-55c6f420da4b req-32010d0d-cf69-4f93-b18b-95b7572e0e8f service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1adcab79-2714-4990-b2ed-55c6f420da4b req-32010d0d-cf69-4f93-b18b-95b7572e0e8f service nova] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1adcab79-2714-4990-b2ed-55c6f420da4b req-32010d0d-cf69-4f93-b18b-95b7572e0e8f service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-1adcab79-2714-4990-b2ed-55c6f420da4b req-32010d0d-cf69-4f93-b18b-95b7572e0e8f service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-1adcab79-2714-4990-b2ed-55c6f420da4b req-32010d0d-cf69-4f93-b18b-95b7572e0e8f service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] No waiting events found dispatching network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:36 user nova-compute[74429]: WARNING nova.compute.manager [req-1adcab79-2714-4990-b2ed-55c6f420da4b req-32010d0d-cf69-4f93-b18b-95b7572e0e8f service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received unexpected event network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 for instance with vm_state building and task_state spawning.
Oct 23 20:29:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-14dec603-e8ad-49f5-be19-7d71789ed05d req-9523a813-edce-44a5-9510-8c746f4544b5 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-14dec603-e8ad-49f5-be19-7d71789ed05d req-9523a813-edce-44a5-9510-8c746f4544b5 service nova] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-14dec603-e8ad-49f5-be19-7d71789ed05d req-9523a813-edce-44a5-9510-8c746f4544b5 service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-14dec603-e8ad-49f5-be19-7d71789ed05d req-9523a813-edce-44a5-9510-8c746f4544b5 service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-14dec603-e8ad-49f5-be19-7d71789ed05d req-9523a813-edce-44a5-9510-8c746f4544b5 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] No waiting events found dispatching network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:38 user nova-compute[74429]: WARNING nova.compute.manager [req-14dec603-e8ad-49f5-be19-7d71789ed05d req-9523a813-edce-44a5-9510-8c746f4544b5 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received unexpected event network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 for instance with vm_state building and task_state spawning.
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:29:38 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Instance spawned successfully.
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:38 user nova-compute[74429]: INFO nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Took 6.19 seconds to spawn the instance on the hypervisor.
Oct 23 20:29:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:29:38 user nova-compute[74429]: INFO nova.compute.manager [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Took 6.99 seconds to build instance.
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-98a82222-1ab0-406d-82a2-1e25ade687af tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.117s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:39 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:29:39 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8319MB free_disk=25.203083038330078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 81531119-0cca-4cf3-9cfc-113587c2c786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2518683a-1e9b-4b01-9016-926336496b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5c7005a2-402e-46c5-be64-9978443cdf0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 581e7447-603c-49ce-90e3-be01d76865f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 663ca7bc-4de5-4800-9d95-7a7d2f2826c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:29:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:42 user nova-compute[74429]: INFO nova.compute.manager [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Rebooting instance
Oct 23 20:29:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-0e0e9277-bba2-4859-a807-08efd9b296ed req-be001711-f2c2-4607-b5ac-d43d11a27723 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-unplugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0e0e9277-bba2-4859-a807-08efd9b296ed req-be001711-f2c2-4607-b5ac-d43d11a27723 service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0e0e9277-bba2-4859-a807-08efd9b296ed req-be001711-f2c2-4607-b5ac-d43d11a27723 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0e0e9277-bba2-4859-a807-08efd9b296ed req-be001711-f2c2-4607-b5ac-d43d11a27723 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-0e0e9277-bba2-4859-a807-08efd9b296ed req-be001711-f2c2-4607-b5ac-d43d11a27723 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-unplugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:44 user nova-compute[74429]: WARNING nova.compute.manager [req-0e0e9277-bba2-4859-a807-08efd9b296ed req-be001711-f2c2-4607-b5ac-d43d11a27723 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-unplugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:29:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance destroyed successfully.
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'resources' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1278903747',display_name='tempest-TestMinimumBasicScenario-server-1278903747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1278903747',id=39,image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVOu61QiuMOdhKgN23vTwIBy3ZDi/QNDbNem0dxxsQ5MvbHXsvaF8Qm9i7aYGoWDJbi34Pu/Qb2QmK1TmvOvfaf0I2gaMQloC9SU+lPc33jCOZoWhlwPv6lRvXE8O6iw==',key_name='tempest-TestMinimumBasicScenario-1983512050',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-5uco920c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:29:44Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=2518683a-1e9b-4b01-9016-926336496b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e7e5fc-0c, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48a80a22-fa2d-462f-9a71-c38d55073228) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:44 user nova-compute[74429]: INFO os_vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c')
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:29:44 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c9f21-d0c1-4fe5-8cd9-8c1190ce9bbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:29:44 user nova-compute[74429]: No targets found.
Oct 23 20:29:44 user nova-compute[74429]: iSNS:
Oct 23 20:29:44 user nova-compute[74429]: No targets found.
Oct 23 20:29:44 user nova-compute[74429]: STATIC:
Oct 23 20:29:44 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:29:44 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:44 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:44 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f
Oct 23 20:29:44 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:44 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:44 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc
Oct 23 20:29:44 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:29:44 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:29:44 user nova-compute[74429]: FIRMWARE:
Oct 23 20:29:44 user nova-compute[74429]: No targets found.
Oct 23 20:29:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:29:44 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:29:44 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f98db-0401-4982-af55-0b1fde46897d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfdedf2-5304-4827-9d7e-3baa9a1d3e02]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:44 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:44 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:44 user nova-compute[74429]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:44 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580dad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6afe7d4-a7cf-44fe-a293-6a239d016e6d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7acfe9-0b38-4d31-8d5c-f997a874c4b7]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cbf1b5-8664-4785-a17a-8baa45d8b75a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86284e-c4c7-48b8-bb04-befa9c046004]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ed7b6-7ae5-4cbd-b973-b6694cd94e94]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8f6b1f-396f-48e4-9c84-742425c37a6c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]
Oct 23 20:29:44 user nova-compute[74429]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.
Oct 23 20:29:44 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[849f01f4-c8d9-4b86-bcca-52d291ed364e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== disconnect_volume: return (332ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Start _get_guest_xml network_info=[{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94af6c0e-d7e9-454b-8ee8-85710969888c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '94af6c0e-d7e9-454b-8ee8-85710969888c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'fcceaf0a-4f9b-4367-afd6-f17f9e8722df', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2518683a-1e9b-4b01-9016-926336496b5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'serial': 'aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:29:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:29:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94af6c0e-d7e9-454b-8ee8-85710969888c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:44 user nova-compute[74429]: DEBUG nova.objects.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Object Instance<2518683a-1e9b-4b01-9016-926336496b5f> lazy-loaded attributes: resources,vcpu_model {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:29:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:45 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:29:45 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c591e-1f91-473b-b9b5-704ea328f78b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:29:45 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a8aeb-8daf-4fb4-a432-bb3160e08976]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f] added
Oct 23 20:29:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238ab34-d0fb-41f8-8e39-0a9f1ba6f582]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924c5d4-dacc-4f08-8aa0-3b5530aa86f4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuUJxLQB {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuUJxLQB" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3756c1c6-21e3-4215-bb32-3fbbb1de3ade]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuUJxLQB'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0aa67-0df2-4065-a834-79ab379ea912]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86b094-0bf1-4cff-b4f3-87dfc4ed9ed2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:45 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:45 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b933b-c25b-4e80-864d-4121227a01a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]
Oct 23 20:29:45 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.
Oct 23 20:29:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be28c0-3405-4f21-9e91-a6b3c3f91f93]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc6786-8a36-4c9c-b0a4-439e0fc5a3ee]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:45 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:45 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:29:45 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:29:45 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:29:45 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ba55c-94ac-4689-856a-ff9bc2f9833a]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:29:45 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-ff9203c2-6a6d-45a2-a1b0-ca85cfb49ee3 req-ad046753-630e-4ec8-aa33-c7a8709c9001 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ff9203c2-6a6d-45a2-a1b0-ca85cfb49ee3 req-ad046753-630e-4ec8-aa33-c7a8709c9001 service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ff9203c2-6a6d-45a2-a1b0-ca85cfb49ee3 req-ad046753-630e-4ec8-aa33-c7a8709c9001 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ff9203c2-6a6d-45a2-a1b0-ca85cfb49ee3 req-ad046753-630e-4ec8-aa33-c7a8709c9001 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-ff9203c2-6a6d-45a2-a1b0-ca85cfb49ee3 req-ad046753-630e-4ec8-aa33-c7a8709c9001 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:46 user nova-compute[74429]: WARNING nova.compute.manager [req-ff9203c2-6a6d-45a2-a1b0-ca85cfb49ee3 req-ad046753-630e-4ec8-aa33-c7a8709c9001 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 20:29:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23834636432663238', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834636432663238', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1278903747',display_name='tempest-TestMinimumBasicScenario-server-1278903747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1278903747',id=39,image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVOu61QiuMOdhKgN23vTwIBy3ZDi/QNDbNem0dxxsQ5MvbHXsvaF8Qm9i7aYGoWDJbi34Pu/Qb2QmK1TmvOvfaf0I2gaMQloC9SU+lPc33jCOZoWhlwPv6lRvXE8O6iw==',key_name='tempest-TestMinimumBasicScenario-1983512050',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-5uco920c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:29:44Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=2518683a-1e9b-4b01-9016-926336496b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'pci_devices' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.objects.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Object Instance<2518683a-1e9b-4b01-9016-926336496b5f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:29:46 user nova-compute[74429]:   <uuid>2518683a-1e9b-4b01-9016-926336496b5f</uuid>
Oct 23 20:29:46 user nova-compute[74429]:   <name>instance-00000027</name>
Oct 23 20:29:46 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:29:46 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:29:46 user nova-compute[74429]:   <metadata>
Oct 23 20:29:46 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:29:46 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:29:46 user nova-compute[74429]:       <nova:name>tempest-TestMinimumBasicScenario-server-1278903747</nova:name>
Oct 23 20:29:46 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:29:44</nova:creationTime>
Oct 23 20:29:46 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:29:46 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:29:46 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:29:46 user nova-compute[74429]:       <nova:owner>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:user uuid="12045265f772493984fb3d041c8e9456">tempest-TestMinimumBasicScenario-1495059245-project-member</nova:user>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:project uuid="8b1ae5a56f0d49dfb7f0aa63f8ef19ec">tempest-TestMinimumBasicScenario-1495059245</nova:project>
Oct 23 20:29:46 user nova-compute[74429]:       </nova:owner>
Oct 23 20:29:46 user nova-compute[74429]:       <nova:root type="image" uuid="94af6c0e-d7e9-454b-8ee8-85710969888c"/>
Oct 23 20:29:46 user nova-compute[74429]:       <nova:ports>
Oct 23 20:29:46 user nova-compute[74429]:         <nova:port uuid="28e7e5fc-0cca-43ff-871e-bf30593b788e">
Oct 23 20:29:46 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 20:29:46 user nova-compute[74429]:         </nova:port>
Oct 23 20:29:46 user nova-compute[74429]:       </nova:ports>
Oct 23 20:29:46 user nova-compute[74429]:     </nova:instance>
Oct 23 20:29:46 user nova-compute[74429]:   </metadata>
Oct 23 20:29:46 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:29:46 user nova-compute[74429]:     <system>
Oct 23 20:29:46 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:29:46 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:29:46 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:29:46 user nova-compute[74429]:       <entry name="serial">2518683a-1e9b-4b01-9016-926336496b5f</entry>
Oct 23 20:29:46 user nova-compute[74429]:       <entry name="uuid">2518683a-1e9b-4b01-9016-926336496b5f</entry>
Oct 23 20:29:46 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:29:46 user nova-compute[74429]:     </system>
Oct 23 20:29:46 user nova-compute[74429]:   </sysinfo>
Oct 23 20:29:46 user nova-compute[74429]:   <os>
Oct 23 20:29:46 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:29:46 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:29:46 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:29:46 user nova-compute[74429]:   </os>
Oct 23 20:29:46 user nova-compute[74429]:   <features>
Oct 23 20:29:46 user nova-compute[74429]:     <acpi/>
Oct 23 20:29:46 user nova-compute[74429]:     <apic/>
Oct 23 20:29:46 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:29:46 user nova-compute[74429]:   </features>
Oct 23 20:29:46 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:29:46 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:29:46 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:29:46 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:29:46 user nova-compute[74429]:   </clock>
Oct 23 20:29:46 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:29:46 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:29:46 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:29:46 user nova-compute[74429]:   </cpu>
Oct 23 20:29:46 user nova-compute[74429]:   <devices>
Oct 23 20:29:46 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:29:46 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:29:46 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk"/>
Oct 23 20:29:46 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:29:46 user nova-compute[74429]:     </disk>
Oct 23 20:29:46 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:29:46 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:29:46 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:29:46 user nova-compute[74429]:       <target dev="vdb" bus="virtio"/>
Oct 23 20:29:46 user nova-compute[74429]:       <serial>aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f</serial>
Oct 23 20:29:46 user nova-compute[74429]:     </disk>
Oct 23 20:29:46 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:29:46 user nova-compute[74429]:       <mac address="fa:16:3e:9e:7a:d6"/>
Oct 23 20:29:46 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:29:46 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:29:46 user nova-compute[74429]:       <target dev="tap28e7e5fc-0c"/>
Oct 23 20:29:46 user nova-compute[74429]:     </interface>
Oct 23 20:29:46 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:29:46 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/console.log" append="off"/>
Oct 23 20:29:46 user nova-compute[74429]:     </serial>
Oct 23 20:29:46 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:29:46 user nova-compute[74429]:     <video>
Oct 23 20:29:46 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:29:46 user nova-compute[74429]:     </video>
Oct 23 20:29:46 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:29:46 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:29:46 user nova-compute[74429]:     </rng>
Oct 23 20:29:46 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:29:46 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:29:46 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:29:46 user nova-compute[74429]:     </memballoon>
Oct 23 20:29:46 user nova-compute[74429]:   </devices>
Oct 23 20:29:46 user nova-compute[74429]: </domain>
Oct 23 20:29:46 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.objects.instance [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG nova.objects.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Object Instance<2518683a-1e9b-4b01-9016-926336496b5f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:29:46 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec --force-share --output=json" returned: 0 in 0.200s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Cannot resize image /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.objects.instance [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'migration_context' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.objects.base [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Object Instance<2518683a-1e9b-4b01-9016-926336496b5f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74429) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1278903747',display_name='tempest-TestMinimumBasicScenario-server-1278903747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1278903747',id=39,image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVOu61QiuMOdhKgN23vTwIBy3ZDi/QNDbNem0dxxsQ5MvbHXsvaF8Qm9i7aYGoWDJbi34Pu/Qb2QmK1TmvOvfaf0I2gaMQloC9SU+lPc33jCOZoWhlwPv6lRvXE8O6iw==',key_name='tempest-TestMinimumBasicScenario-1983512050',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-5uco920c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:29:44Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=2518683a-1e9b-4b01-9016-926336496b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG os_vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebf46f2b-3200-5f73-911e-e2cd9eeea35f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e7e5fc-0c, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e7e5fc-0c, col_values=(('qos', UUID('0f171bc5-9841-4abb-890b-33514e3084e1')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e7e5fc-0c, col_values=(('external_ids', {'iface-id': '28e7e5fc-0cca-43ff-871e-bf30593b788e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:7a:d6', 'vm-uuid': '2518683a-1e9b-4b01-9016-926336496b5f'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:47 user nova-compute[74429]: INFO os_vif [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c')
Oct 23 20:29:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:29:48 user nova-compute[74429]: INFO nova.compute.claims [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Claim successful on node user
Oct 23 20:29:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:29:49 user nova-compute[74429]: INFO nova.virt.block_device [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Booting with volume snapshot 5ffdea7b-e165-40ae-a383-e3ee7a6725c9 at /dev/vda
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-50756317-2522-4aad-94e7-aba6ca0ce894 req-9920c0c8-07f8-4698-b618-27479960792f service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-50756317-2522-4aad-94e7-aba6ca0ce894 req-9920c0c8-07f8-4698-b618-27479960792f service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-50756317-2522-4aad-94e7-aba6ca0ce894 req-9920c0c8-07f8-4698-b618-27479960792f service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-50756317-2522-4aad-94e7-aba6ca0ce894 req-9920c0c8-07f8-4698-b618-27479960792f service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-50756317-2522-4aad-94e7-aba6ca0ce894 req-9920c0c8-07f8-4698-b618-27479960792f service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:49 user nova-compute[74429]: WARNING nova.compute.manager [req-50756317-2522-4aad-94e7-aba6ca0ce894 req-9920c0c8-07f8-4698-b618-27479960792f service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state active and task_state reboot_started_hard.
Oct 23 20:29:49 user nova-compute[74429]: DEBUG nova.policy [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8399a03e24cd4cd7bbd8bdd9558d0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827ab59e22b4fa69f1475517e89727a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Successfully created port: 8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Successfully updated port: 8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquired lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:29:51 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance rebooted successfully.
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-12cef3b8-a65b-4e73-86ec-760d56447ab0 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.613s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updating instance_info_cache with network_info: [{"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Releasing lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Instance network_info: |[{"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:51 user nova-compute[74429]: WARNING nova.compute.manager [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state active and task_state None.
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-changed-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.compute.manager [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Refreshing instance network info cache due to event network-changed-8b31a6d4-e4b5-478f-8546-a978e307ef60. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] Acquiring lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] Acquired lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:29:51 user nova-compute[74429]: DEBUG nova.network.neutron [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Refreshing network info cache for port 8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:29:52 user nova-compute[74429]: DEBUG nova.network.neutron [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updated VIF entry in instance network info cache for port 8b31a6d4-e4b5-478f-8546-a978e307ef60. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:29:52 user nova-compute[74429]: DEBUG nova.network.neutron [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updating instance_info_cache with network_info: [{"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c1723eb1-22b4-477d-ac3a-92ea5afaeb3d req-dd911331-9dd5-405b-80e6-a1376c8e017b service nova] Releasing lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:29:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:57 user nova-compute[74429]: INFO nova.compute.manager [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Terminating instance
Oct 23 20:29:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb3d673-cf3e-4c54-9202-98dd61cdc441 req-2c7c86d4-6f34-45f2-a679-2cc48bcc5c10 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-vif-unplugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb3d673-cf3e-4c54-9202-98dd61cdc441 req-2c7c86d4-6f34-45f2-a679-2cc48bcc5c10 service nova] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb3d673-cf3e-4c54-9202-98dd61cdc441 req-2c7c86d4-6f34-45f2-a679-2cc48bcc5c10 service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5cb3d673-cf3e-4c54-9202-98dd61cdc441 req-2c7c86d4-6f34-45f2-a679-2cc48bcc5c10 service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb3d673-cf3e-4c54-9202-98dd61cdc441 req-2c7c86d4-6f34-45f2-a679-2cc48bcc5c10 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] No waiting events found dispatching network-vif-unplugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-5cb3d673-cf3e-4c54-9202-98dd61cdc441 req-2c7c86d4-6f34-45f2-a679-2cc48bcc5c10 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-vif-unplugged-22896824-ac74-4896-95ba-4e15adf3956d for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Instance destroyed successfully.
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lazy-loading 'resources' on Instance uuid 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-909208154',display_name='tempest-TestServerVolumeAttachmentScenario-server-909208154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-909208154',id=37,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIDCQfCRzdZTCwlnax+gIuTZGswCjy/f/U3S66oFduqYFrurUtWMsILWv214PATawvy0JGDvzt5BhEUqTx12LPrgTPwcM7r6EXmwBJ6/IACkbaPdW71Rnf6AEWuEA5cOw==',key_name='tempest-keypair-732979404',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:25:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e0a90baa2ec4f39a50b506e7349bcc9',ramdisk_id='',reservation_id='r-mhk1vldw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2002412235',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2002412235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91de23aa72264f5dacc767dc107809a6',uuid=1c7320b8-6b41-4f8d-a7f7-d0526498b6f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Converting VIF {"id": "22896824-ac74-4896-95ba-4e15adf3956d", "address": "fa:16:3e:8c:38:3c", "network": {"id": "b4950cb5-2c9c-40c3-8215-441a72ebd5ca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1224859886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e0a90baa2ec4f39a50b506e7349bcc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22896824-ac", "ovs_interfaceid": "22896824-ac74-4896-95ba-4e15adf3956d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG os_vif [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22896824-ac, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05a44681-4959-4cdb-8bf3-fc9eb88f51d3) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:29:58 user nova-compute[74429]: INFO os_vif [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=22896824-ac74-4896-95ba-4e15adf3956d,network=Network(b4950cb5-2c9c-40c3-8215-441a72ebd5ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22896824-ac')
Oct 23 20:29:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Deleting instance files /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8_del
Oct 23 20:29:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Deletion of /opt/stack/data/nova/instances/1c7320b8-6b41-4f8d-a7f7-d0526498b6f8_del complete
Oct 23 20:29:58 user nova-compute[74429]: INFO nova.compute.manager [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 20:29:58 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:29:58 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-391fb5bc-c2b4-4ec6-ae1d-2b96f4fe9ace req-f2c41b6a-c306-4c94-b6f4-d0fb175c5d82 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-vif-deleted-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:29:59 user nova-compute[74429]: INFO nova.compute.manager [req-391fb5bc-c2b4-4ec6-ae1d-2b96f4fe9ace req-f2c41b6a-c306-4c94-b6f4-d0fb175c5d82 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Neutron deleted interface 22896824-ac74-4896-95ba-4e15adf3956d; detaching it from the instance and deleting it from the info cache
Oct 23 20:29:59 user nova-compute[74429]: DEBUG nova.network.neutron [req-391fb5bc-c2b4-4ec6-ae1d-2b96f4fe9ace req-f2c41b6a-c306-4c94-b6f4-d0fb175c5d82 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:29:59 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Took 0.85 seconds to deallocate network for instance.
Oct 23 20:29:59 user nova-compute[74429]: DEBUG nova.compute.manager [req-391fb5bc-c2b4-4ec6-ae1d-2b96f4fe9ace req-f2c41b6a-c306-4c94-b6f4-d0fb175c5d82 service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Detach interface failed, port_id=22896824-ac74-4896-95ba-4e15adf3956d, reason: Instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:29:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:30:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:00 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Deleted allocations for instance 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8
Oct 23 20:30:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f84afc5f-199f-4311-b837-6ce6c2d20a7f tempest-TestServerVolumeAttachmentScenario-2002412235 tempest-TestServerVolumeAttachmentScenario-2002412235-project-member] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-a99421d4-a637-445d-bbdf-79f5bf0f47d9 req-cd9a2568-711c-4233-9764-c946aeefb77f service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received event network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:30:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a99421d4-a637-445d-bbdf-79f5bf0f47d9 req-cd9a2568-711c-4233-9764-c946aeefb77f service nova] Acquiring lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a99421d4-a637-445d-bbdf-79f5bf0f47d9 req-cd9a2568-711c-4233-9764-c946aeefb77f service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a99421d4-a637-445d-bbdf-79f5bf0f47d9 req-cd9a2568-711c-4233-9764-c946aeefb77f service nova] Lock "1c7320b8-6b41-4f8d-a7f7-d0526498b6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-a99421d4-a637-445d-bbdf-79f5bf0f47d9 req-cd9a2568-711c-4233-9764-c946aeefb77f service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] No waiting events found dispatching network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:30:00 user nova-compute[74429]: WARNING nova.compute.manager [req-a99421d4-a637-445d-bbdf-79f5bf0f47d9 req-cd9a2568-711c-4233-9764-c946aeefb77f service nova] [instance: 1c7320b8-6b41-4f8d-a7f7-d0526498b6f8] Received unexpected event network-vif-plugged-22896824-ac74-4896-95ba-4e15adf3956d for instance with vm_state deleted and task_state None.
Oct 23 20:30:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG os_brick.utils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed30c6-af7a-4bab-9250-9a0b319c18cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbb5d23-fa44-4d21-a389-869ee8187c1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc547b-962e-4f7c-b851-6cf860d81456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[53576423-9ab4-4c59-a748-19a80a735444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:30:15 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:30:15 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f5e26-de5d-4b2c-a673-1d02a99aaab7]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG os_brick.utils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:30:15 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updating existing volume attachment record: 24ae8b28-6c62-41eb-af30-1c2358d1cb7f {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:30:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:22 user nova-compute[74429]: INFO nova.compute.manager [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Terminating instance
Oct 23 20:30:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-0540b5a2-12cd-4ced-82c7-08f1efaaf6c9 req-5e21018f-e10d-4611-8cb5-3ddcd1bbb237 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-vif-unplugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0540b5a2-12cd-4ced-82c7-08f1efaaf6c9 req-5e21018f-e10d-4611-8cb5-3ddcd1bbb237 service nova] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0540b5a2-12cd-4ced-82c7-08f1efaaf6c9 req-5e21018f-e10d-4611-8cb5-3ddcd1bbb237 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0540b5a2-12cd-4ced-82c7-08f1efaaf6c9 req-5e21018f-e10d-4611-8cb5-3ddcd1bbb237 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-0540b5a2-12cd-4ced-82c7-08f1efaaf6c9 req-5e21018f-e10d-4611-8cb5-3ddcd1bbb237 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] No waiting events found dispatching network-vif-unplugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:30:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-0540b5a2-12cd-4ced-82c7-08f1efaaf6c9 req-5e21018f-e10d-4611-8cb5-3ddcd1bbb237 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-vif-unplugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:30:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Instance destroyed successfully.
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lazy-loading 'resources' on Instance uuid 81531119-0cca-4cf3-9cfc-113587c2c786 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-726237298',display_name='tempest-SnapshotDataIntegrityTests-server-726237298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-726237298',id=34,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qHYulHsAPrw9za7o0l8P3WKT/KyPi12shDygZpbtGj06UvfzujNylV9pwLpT1HHGqHRfoL9e7Vy5DAEH9DYzIouLkU7jaX4JD2kNgWy98c7bUJc3N6CwtxXCuUKYg4A==',key_name='tempest-keypair-44181116',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0520808b577c4d5ab4a93ad903dfce2f',ramdisk_id='',reservation_id='r-1ohh4qcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1581079693',owner_user_name='tempest-SnapshotDataIntegrityTests-1581079693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:20:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a79f42a7a6344b969b6656fcb17906f6',uuid=81531119-0cca-4cf3-9cfc-113587c2c786,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Converting VIF {"id": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "address": "fa:16:3e:3d:22:97", "network": {"id": "4a40dc96-0b1a-4c42-a298-1188b99ed2ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2140952968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0520808b577c4d5ab4a93ad903dfce2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3468ca7c-1e", "ovs_interfaceid": "3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG os_vif [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3468ca7c-1e, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5507b165-8826-45a7-8c1a-ee7240552a40) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:30:23 user nova-compute[74429]: INFO os_vif [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:22:97,bridge_name='br-int',has_traffic_filtering=True,id=3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6,network=Network(4a40dc96-0b1a-4c42-a298-1188b99ed2ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3468ca7c-1e')
Oct 23 20:30:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Deleting instance files /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786_del
Oct 23 20:30:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Deletion of /opt/stack/data/nova/instances/81531119-0cca-4cf3-9cfc-113587c2c786_del complete
Oct 23 20:30:23 user nova-compute[74429]: INFO nova.compute.manager [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 20:30:23 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:30:23 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Took 0.67 seconds to deallocate network for instance.
Oct 23 20:30:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:24 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Deleted allocations for instance 81531119-0cca-4cf3-9cfc-113587c2c786
Oct 23 20:30:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ac574244-ce98-4aa6-9be6-1b5b2597de3d tempest-SnapshotDataIntegrityTests-1581079693 tempest-SnapshotDataIntegrityTests-1581079693-project-member] Lock "81531119-0cca-4cf3-9cfc-113587c2c786" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] Acquiring lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] Lock "81531119-0cca-4cf3-9cfc-113587c2c786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] No waiting events found dispatching network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:30:24 user nova-compute[74429]: WARNING nova.compute.manager [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received unexpected event network-vif-plugged-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 for instance with vm_state deleted and task_state None.
Oct 23 20:30:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-91e2de78-3c68-43ae-b8d6-40fd9d550b51 req-bb6899e8-436a-4a54-b13a-c7253668bcb1 service nova] [instance: 81531119-0cca-4cf3-9cfc-113587c2c786] Received event network-vif-deleted-3468ca7c-1e9f-4aac-b3c5-d6fc21e291b6 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:30:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:30:33 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Creating image(s)
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Ensure instance console log exists: /opt/stack/data/nova/instances/e6f39c99-9d07-4784-ab41-245408d9ff0a/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Start _get_guest_xml network_info=[{"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-23T20:29:36Z,direct_url=<?>,disk_format='qcow2',id=28cdb3f3-b6cb-423f-8009-2d0d0104163d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-574678421',owner='6827ab59e22b4fa69f1475517e89727a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-23T20:29:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '24ae8b28-6c62-41eb-af30-1c2358d1cb7f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQrXVzxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6f39c99-9d07-4784-ab41-245408d9ff0a', 'attached_at': '', 'detached_at': '', 'volume_id': '402e3d81-582d-4e5e-8039-7ffb06858c04', 'serial': '402e3d81-582d-4e5e-8039-7ffb06858c04'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:33 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:30:33 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-23T20:29:36Z,direct_url=<?>,disk_format='qcow2',id=28cdb3f3-b6cb-423f-8009-2d0d0104163d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-574678421',owner='6827ab59e22b4fa69f1475517e89727a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-23T20:29:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQrXVzxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:30:33 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:30:33 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:30:33 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0083bb-34e1-4f57-8213-9263c83c50e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:30:33 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[778e1de5-5583-40cf-9a9f-d4c31ee14c58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04] added
Oct 23 20:30:33 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e058af4-f36f-4605-9d57-13ad347f4ef5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5b19c-8cd1-4701-af7f-13d6648ffc13]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQrXVzxi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQrXVzxi" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2295e-289b-4197-8edf-c97605df7cd5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RQrXVzxi'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d562c84c-17f7-4b36-91dc-e5b24725626a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0a41d-7f6d-450e-9c63-7c41fe4ea54f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:30:33 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:30:33 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a7831-6ad2-45a5-b00d-8fd2ccc27d64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260]
Oct 23 20:30:33 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260] successful.
Oct 23 20:30:33 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6265402c-a83f-46e6-bc37-fe2eb35f517c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[260822d6-c807-46b9-b78b-18500ff0d7c9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)
Oct 23 20:30:33 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:30:33 user nova-compute[74429]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)
Oct 23 20:30:33 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[32af3b97-5aed-4e65-bb6d-c624a70cb9ee]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:30:33 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQrXVzxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23561613537303062', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561613537303062', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-250864351',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-250864351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-250864351',id=43,image_ref='28cdb3f3-b6cb-423f-8009-2d0d0104163d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbihZhOxNxVpi1x0+DDjjpYzzAkBkH5pHxk1pbG9QyQ/WMIjlhBtf70iyXmzmSSQDx+8mbsrfw7WJMy4ibYfAenClpMyTlIqIpNnpGqHdfgtVZWDg//yt7X10MYrrKfHw==',key_name='tempest-keypair-1069166463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-5tq0lyft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2072234131',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=e6f39c99-9d07-4784-ab41-245408d9ff0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.objects.instance [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'pci_devices' on Instance uuid e6f39c99-9d07-4784-ab41-245408d9ff0a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:30:34 user nova-compute[74429]:   <uuid>e6f39c99-9d07-4784-ab41-245408d9ff0a</uuid>
Oct 23 20:30:34 user nova-compute[74429]:   <name>instance-0000002b</name>
Oct 23 20:30:34 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:30:34 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:30:34 user nova-compute[74429]:   <metadata>
Oct 23 20:30:34 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:30:34 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:30:34 user nova-compute[74429]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-250864351</nova:name>
Oct 23 20:30:34 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:30:33</nova:creationTime>
Oct 23 20:30:34 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:30:34 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:30:34 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:30:34 user nova-compute[74429]:       <nova:owner>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:user uuid="8399a03e24cd4cd7bbd8bdd9558d0798">tempest-TestVolumeBootPattern-2072234131-project-member</nova:user>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:project uuid="6827ab59e22b4fa69f1475517e89727a">tempest-TestVolumeBootPattern-2072234131</nova:project>
Oct 23 20:30:34 user nova-compute[74429]:       </nova:owner>
Oct 23 20:30:34 user nova-compute[74429]:       <nova:root type="image" uuid="28cdb3f3-b6cb-423f-8009-2d0d0104163d"/>
Oct 23 20:30:34 user nova-compute[74429]:       <nova:ports>
Oct 23 20:30:34 user nova-compute[74429]:         <nova:port uuid="8b31a6d4-e4b5-478f-8546-a978e307ef60">
Oct 23 20:30:34 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 20:30:34 user nova-compute[74429]:         </nova:port>
Oct 23 20:30:34 user nova-compute[74429]:       </nova:ports>
Oct 23 20:30:34 user nova-compute[74429]:     </nova:instance>
Oct 23 20:30:34 user nova-compute[74429]:   </metadata>
Oct 23 20:30:34 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:30:34 user nova-compute[74429]:     <system>
Oct 23 20:30:34 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:30:34 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:30:34 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:30:34 user nova-compute[74429]:       <entry name="serial">e6f39c99-9d07-4784-ab41-245408d9ff0a</entry>
Oct 23 20:30:34 user nova-compute[74429]:       <entry name="uuid">e6f39c99-9d07-4784-ab41-245408d9ff0a</entry>
Oct 23 20:30:34 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:30:34 user nova-compute[74429]:     </system>
Oct 23 20:30:34 user nova-compute[74429]:   </sysinfo>
Oct 23 20:30:34 user nova-compute[74429]:   <os>
Oct 23 20:30:34 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:30:34 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:30:34 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:30:34 user nova-compute[74429]:   </os>
Oct 23 20:30:34 user nova-compute[74429]:   <features>
Oct 23 20:30:34 user nova-compute[74429]:     <acpi/>
Oct 23 20:30:34 user nova-compute[74429]:     <apic/>
Oct 23 20:30:34 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:30:34 user nova-compute[74429]:   </features>
Oct 23 20:30:34 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:30:34 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:30:34 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:30:34 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:30:34 user nova-compute[74429]:   </clock>
Oct 23 20:30:34 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:30:34 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:30:34 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:30:34 user nova-compute[74429]:   </cpu>
Oct 23 20:30:34 user nova-compute[74429]:   <devices>
Oct 23 20:30:34 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:30:34 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:30:34 user nova-compute[74429]:       <source dev="/dev/sdd"/>
Oct 23 20:30:34 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:30:34 user nova-compute[74429]:       <serial>402e3d81-582d-4e5e-8039-7ffb06858c04</serial>
Oct 23 20:30:34 user nova-compute[74429]:     </disk>
Oct 23 20:30:34 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:30:34 user nova-compute[74429]:       <mac address="fa:16:3e:d5:f7:2a"/>
Oct 23 20:30:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:30:34 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:30:34 user nova-compute[74429]:       <target dev="tap8b31a6d4-e4"/>
Oct 23 20:30:34 user nova-compute[74429]:     </interface>
Oct 23 20:30:34 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:30:34 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/e6f39c99-9d07-4784-ab41-245408d9ff0a/console.log" append="off"/>
Oct 23 20:30:34 user nova-compute[74429]:     </serial>
Oct 23 20:30:34 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:30:34 user nova-compute[74429]:     <video>
Oct 23 20:30:34 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:30:34 user nova-compute[74429]:     </video>
Oct 23 20:30:34 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:30:34 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:30:34 user nova-compute[74429]:     </rng>
Oct 23 20:30:34 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:30:34 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:30:34 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:30:34 user nova-compute[74429]:     </memballoon>
Oct 23 20:30:34 user nova-compute[74429]:   </devices>
Oct 23 20:30:34 user nova-compute[74429]: </domain>
Oct 23 20:30:34 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-250864351',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-250864351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-250864351',id=43,image_ref='28cdb3f3-b6cb-423f-8009-2d0d0104163d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbihZhOxNxVpi1x0+DDjjpYzzAkBkH5pHxk1pbG9QyQ/WMIjlhBtf70iyXmzmSSQDx+8mbsrfw7WJMy4ibYfAenClpMyTlIqIpNnpGqHdfgtVZWDg//yt7X10MYrrKfHw==',key_name='tempest-keypair-1069166463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-5tq0lyft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2072234131',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=e6f39c99-9d07-4784-ab41-245408d9ff0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG os_vif [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d45ba75-5da9-5c10-ba1a-4f4498eced1c', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b31a6d4-e4, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b31a6d4-e4, col_values=(('qos', UUID('fc2841b8-3a17-422e-8f02-ebb5fa60442f')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b31a6d4-e4, col_values=(('external_ids', {'iface-id': '8b31a6d4-e4b5-478f-8546-a978e307ef60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f7:2a', 'vm-uuid': 'e6f39c99-9d07-4784-ab41-245408d9ff0a'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:34 user nova-compute[74429]: INFO os_vif [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4')
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No VIF found with MAC fa:16:3e:d5:f7:2a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-c0092d75-ecbd-490a-aaf3-4533b38215eb req-63ac501b-ff05-4d1b-bec1-e5372a69ede6 service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c0092d75-ecbd-490a-aaf3-4533b38215eb req-63ac501b-ff05-4d1b-bec1-e5372a69ede6 service nova] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c0092d75-ecbd-490a-aaf3-4533b38215eb req-63ac501b-ff05-4d1b-bec1-e5372a69ede6 service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c0092d75-ecbd-490a-aaf3-4533b38215eb req-63ac501b-ff05-4d1b-bec1-e5372a69ede6 service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-c0092d75-ecbd-490a-aaf3-4533b38215eb req-63ac501b-ff05-4d1b-bec1-e5372a69ede6 service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] No waiting events found dispatching network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:30:36 user nova-compute[74429]: WARNING nova.compute.manager [req-c0092d75-ecbd-490a-aaf3-4533b38215eb req-63ac501b-ff05-4d1b-bec1-e5372a69ede6 service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received unexpected event network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 for instance with vm_state building and task_state spawning.
Oct 23 20:30:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:30:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:30:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-de1a8f81-87d5-4773-b2de-7fe5a2b2c8c4 req-73094d07-42f2-4e2e-8fc3-85141b82e874 service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de1a8f81-87d5-4773-b2de-7fe5a2b2c8c4 req-73094d07-42f2-4e2e-8fc3-85141b82e874 service nova] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de1a8f81-87d5-4773-b2de-7fe5a2b2c8c4 req-73094d07-42f2-4e2e-8fc3-85141b82e874 service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-de1a8f81-87d5-4773-b2de-7fe5a2b2c8c4 req-73094d07-42f2-4e2e-8fc3-85141b82e874 service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-de1a8f81-87d5-4773-b2de-7fe5a2b2c8c4 req-73094d07-42f2-4e2e-8fc3-85141b82e874 service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] No waiting events found dispatching network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:30:38 user nova-compute[74429]: WARNING nova.compute.manager [req-de1a8f81-87d5-4773-b2de-7fe5a2b2c8c4 req-73094d07-42f2-4e2e-8fc3-85141b82e874 service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received unexpected event network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 for instance with vm_state building and task_state spawning.
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:30:38 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:30:38 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=25.22693634033203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:30:38 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Instance spawned successfully.
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:30:38 user nova-compute[74429]: INFO nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Took 5.67 seconds to spawn the instance on the hypervisor.
Oct 23 20:30:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:30:38 user nova-compute[74429]: INFO nova.compute.manager [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Took 50.40 seconds to build instance.
Oct 23 20:30:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-737511bb-1395-466c-8711-211342e32563 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.621s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2518683a-1e9b-4b01-9016-926336496b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5c7005a2-402e-46c5-be64-9978443cdf0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 581e7447-603c-49ce-90e3-be01d76865f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 663ca7bc-4de5-4800-9d95-7a7d2f2826c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance e6f39c99-9d07-4784-ab41-245408d9ff0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.872s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:30:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:30:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:30:41 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating instance_info_cache with network_info: [{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:30:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:30:41 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:30:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:30:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:30:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:30:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:30:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:30:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:30:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:30:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:30:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:30:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:30:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:31:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:31:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:31:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:31:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:31:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-changed-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Refreshing instance network info cache due to event network-changed-71f3532e-c21b-4705-9812-b65f2daa2f17. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] Acquiring lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] Acquired lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Refreshing network info cache for port 71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updated VIF entry in instance network info cache for port 71f3532e-c21b-4705-9812-b65f2daa2f17. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updating instance_info_cache with network_info: [{"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-27319e18-feff-4f96-9e7d-3d772890cf95 req-161db88b-435a-4add-a785-6fa906e62b03 service nova] Releasing lock "refresh_cache-663ca7bc-4de5-4800-9d95-7a7d2f2826c4" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:22 user nova-compute[74429]: INFO nova.compute.manager [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Terminating instance
Oct 23 20:31:22 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:31:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Instance destroyed successfully.
Oct 23 20:31:23 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'resources' on Instance uuid 663ca7bc-4de5-4800-9d95-7a7d2f2826c4 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1427631568',display_name='tempest-AttachVolumeNegativeTest-server-1427631568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1427631568',id=42,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTcayXUFFhkWiNMOthoGGfoS6ENCR/1tY/IzjPjWmiNtSqOx5a6FptTbQtDUXcmU8BWYyjQKNofoncJedSifFhbBZMGksgQVd+2b0HPKbmQ7ZfRplHthR0cZGlRlcqZvw==',key_name='tempest-keypair-974514577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:29:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-ktqxji7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=663ca7bc-4de5-4800-9d95-7a7d2f2826c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "71f3532e-c21b-4705-9812-b65f2daa2f17", "address": "fa:16:3e:49:38:44", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f3532e-c2", "ovs_interfaceid": "71f3532e-c21b-4705-9812-b65f2daa2f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG os_vif [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71f3532e-c2, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08b30f2f-8dd1-4237-98b2-32fbee2bda4e) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:23 user nova-compute[74429]: INFO os_vif [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:38:44,bridge_name='br-int',has_traffic_filtering=True,id=71f3532e-c21b-4705-9812-b65f2daa2f17,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f3532e-c2')
Oct 23 20:31:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Deleting instance files /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4_del
Oct 23 20:31:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Deletion of /opt/stack/data/nova/instances/663ca7bc-4de5-4800-9d95-7a7d2f2826c4_del complete
Oct 23 20:31:23 user nova-compute[74429]: INFO nova.compute.manager [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 23 20:31:23 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:31:23 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-vif-unplugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] No waiting events found dispatching network-vif-unplugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-vif-unplugged-71f3532e-c21b-4705-9812-b65f2daa2f17 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] Acquiring lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] No waiting events found dispatching network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:31:24 user nova-compute[74429]: WARNING nova.compute.manager [req-9d9b491d-ee64-4eda-b6ac-d869e1bcccb0 req-56d26e01-512f-4cb4-9b60-90d3d7288699 service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received unexpected event network-vif-plugged-71f3532e-c21b-4705-9812-b65f2daa2f17 for instance with vm_state active and task_state deleting.
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:31:24 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Took 0.95 seconds to deallocate network for instance.
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-ad625937-d096-44cd-83a9-003d891e7f60 req-8a9d0f24-3b84-4768-a6b5-c2410acf11bb service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Received event network-vif-deleted-71f3532e-c21b-4705-9812-b65f2daa2f17 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:31:24 user nova-compute[74429]: INFO nova.compute.manager [req-ad625937-d096-44cd-83a9-003d891e7f60 req-8a9d0f24-3b84-4768-a6b5-c2410acf11bb service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Neutron deleted interface 71f3532e-c21b-4705-9812-b65f2daa2f17; detaching it from the instance and deleting it from the info cache
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-ad625937-d096-44cd-83a9-003d891e7f60 req-8a9d0f24-3b84-4768-a6b5-c2410acf11bb service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-ad625937-d096-44cd-83a9-003d891e7f60 req-8a9d0f24-3b84-4768-a6b5-c2410acf11bb service nova] [instance: 663ca7bc-4de5-4800-9d95-7a7d2f2826c4] Detach interface failed, port_id=71f3532e-c21b-4705-9812-b65f2daa2f17, reason: Instance 663ca7bc-4de5-4800-9d95-7a7d2f2826c4 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:31:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:25 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Deleted allocations for instance 663ca7bc-4de5-4800-9d95-7a7d2f2826c4
Oct 23 20:31:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f0ec0a06-e4ca-4cc2-990b-ebcf01ed835f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "663ca7bc-4de5-4800-9d95-7a7d2f2826c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:31:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing instance network info cache due to event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.network.neutron [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.network.neutron [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated VIF entry in instance network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG nova.network.neutron [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:31:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-da7525fa-24ff-4e3f-a9a1-78840aad84c4 req-45677cc4-d384-410d-832a-f78fa784acb3 service nova] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:31:36 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:31:36 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.243385314941406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing instance network info cache due to event network-changed-28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Refreshing network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2518683a-1e9b-4b01-9016-926336496b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5c7005a2-402e-46c5-be64-9978443cdf0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 581e7447-603c-49ce-90e3-be01d76865f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance e6f39c99-9d07-4784-ab41-245408d9ff0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:31:36 user nova-compute[74429]: INFO nova.compute.manager [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Detaching volume aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:36 user nova-compute[74429]: INFO nova.virt.block_device [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Attempting to driver detach volume aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f from mountpoint /dev/vdb
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Attempting to detach device vdb from instance 2518683a-1e9b-4b01-9016-926336496b5f from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:31:36 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:31:36 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:31:36 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:31:36 user nova-compute[74429]:   <serial>aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f</serial>
Oct 23 20:31:36 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:31:36 user nova-compute[74429]: </disk>
Oct 23 20:31:36 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:31:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully detached device vdb from instance 2518683a-1e9b-4b01-9016-926336496b5f from the persistent domain config.
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2518683a-1e9b-4b01-9016-926336496b5f from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:31:36 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:31:36 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:31:36 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:31:36 user nova-compute[74429]:   <serial>aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f</serial>
Oct 23 20:31:36 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 20:31:36 user nova-compute[74429]: </disk>
Oct 23 20:31:36 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated VIF entry in instance network info cache for port 28e7e5fc-0cca-43ff-871e-bf30593b788e. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0b2420f6-0666-4a40-b7fe-924ec44174d8 req-468235de-f301-4a83-a87e-799f6db681f2 service nova] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:31:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:31:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:31:42 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:31:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [{"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:31:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-2518683a-1e9b-4b01-9016-926336496b5f" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:31:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:31:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:31:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:31:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:31:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:31:56 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2518683a-1e9b-4b01-9016-926336496b5f is timed out.
Oct 23 20:31:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully detached device vdb from instance 2518683a-1e9b-4b01-9016-926336496b5f from the live domain config.
Oct 23 20:31:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuUJxLQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:31:56 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fcd4be-d1ac-4b59-b29e-47f1af3b0b79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:31:56 user nova-compute[74429]: No targets found.
Oct 23 20:31:56 user nova-compute[74429]: iSNS:
Oct 23 20:31:56 user nova-compute[74429]: No targets found.
Oct 23 20:31:56 user nova-compute[74429]: STATIC:
Oct 23 20:31:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04
Oct 23 20:31:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:31:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:31:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:31:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:31:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:31:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f
Oct 23 20:31:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:31:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:31:56 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc
Oct 23 20:31:56 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:31:56 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:31:56 user nova-compute[74429]: FIRMWARE:
Oct 23 20:31:56 user nova-compute[74429]: No targets found.
Oct 23 20:31:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:31:56 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:31:56 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f251f-7d83-4a6c-97f6-e94eeb68fe60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe20f1c-61ee-429c-810c-b43abf8dfecf]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:31:56 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:31:56 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:31:56 user nova-compute[74429]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)
Oct 23 20:31:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:31:56 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:31:56 user nova-compute[74429]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f (non-flash)
Oct 23 20:31:56 user nova-compute[74429]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)
Oct 23 20:31:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5059ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68838d-6060-4f27-99b1-1ae366e12a46]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d5076-d80b-4d3a-8e55-0547e479f136]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[abad65ba-8570-44a5-a80b-2b74f5b0196c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cdde8f-62f3-429b-ba2a-cbdc2403bcce]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:31:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[09012778-4aad-4a1e-8af0-bce9e309d565]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311cb99-061f-4031-9b15-dd7b1e8e0f58]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260]
Oct 23 20:31:57 user nova-compute[74429]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f, portal: 172.16.0.220,3260] successful.
Oct 23 20:31:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aced3cfb-6aa8-4d4c-b4a8-aefc8230b27f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697ec8c-deca-4e66-8c29-6a8fa3350841]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== disconnect_volume: return (283ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:31:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:31:58 user nova-compute[74429]: DEBUG nova.objects.instance [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'flavor' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:31:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-6d9f11f0-a2d9-4163-84f4-a01b4e2c4ad4 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.891s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:31:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:31:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:32:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:14 user nova-compute[74429]: INFO nova.compute.manager [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Detaching volume 560de346-d33e-4d72-9db7-06815574dfbc
Oct 23 20:32:14 user nova-compute[74429]: INFO nova.virt.block_device [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Attempting to driver detach volume 560de346-d33e-4d72-9db7-06815574dfbc from mountpoint /dev/vdb
Oct 23 20:32:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Attempting to detach device vdb from instance 5c7005a2-402e-46c5-be64-9978443cdf0d from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:32:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:32:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:32:14 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:32:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:32:14 user nova-compute[74429]:   <serial>560de346-d33e-4d72-9db7-06815574dfbc</serial>
Oct 23 20:32:14 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:32:14 user nova-compute[74429]: </disk>
Oct 23 20:32:14 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:32:14 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully detached device vdb from instance 5c7005a2-402e-46c5-be64-9978443cdf0d from the persistent domain config.
Oct 23 20:32:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c7005a2-402e-46c5-be64-9978443cdf0d from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:32:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:32:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:32:14 user nova-compute[74429]:   <source dev="/dev/sde"/>
Oct 23 20:32:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:32:14 user nova-compute[74429]:   <serial>560de346-d33e-4d72-9db7-06815574dfbc</serial>
Oct 23 20:32:14 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:32:14 user nova-compute[74429]: </disk>
Oct 23 20:32:14 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:32:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c7005a2-402e-46c5-be64-9978443cdf0d {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:32:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:32:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:32:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:32:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-changed-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:29 user nova-compute[74429]: DEBUG nova.compute.manager [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Refreshing instance network info cache due to event network-changed-8b31a6d4-e4b5-478f-8546-a978e307ef60. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:32:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] Acquiring lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:32:29 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] Acquired lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:32:29 user nova-compute[74429]: DEBUG nova.network.neutron [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Refreshing network info cache for port 8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updated VIF entry in instance network info cache for port 8b31a6d4-e4b5-478f-8546-a978e307ef60. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updating instance_info_cache with network_info: [{"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4a80a6cc-e8b6-468b-9dee-5c2b01abff1a req-1a2e2056-d63d-43e4-b5ec-20772328129a service nova] Releasing lock "refresh_cache-e6f39c99-9d07-4784-ab41-245408d9ff0a" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:30 user nova-compute[74429]: INFO nova.compute.manager [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Terminating instance
Oct 23 20:32:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-d42a7a82-1fb2-40c4-8a57-757460bb66f4 req-385ce48a-dabf-4a27-8ce8-49beff54acee service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-vif-unplugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d42a7a82-1fb2-40c4-8a57-757460bb66f4 req-385ce48a-dabf-4a27-8ce8-49beff54acee service nova] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d42a7a82-1fb2-40c4-8a57-757460bb66f4 req-385ce48a-dabf-4a27-8ce8-49beff54acee service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d42a7a82-1fb2-40c4-8a57-757460bb66f4 req-385ce48a-dabf-4a27-8ce8-49beff54acee service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-d42a7a82-1fb2-40c4-8a57-757460bb66f4 req-385ce48a-dabf-4a27-8ce8-49beff54acee service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] No waiting events found dispatching network-vif-unplugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:32:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-d42a7a82-1fb2-40c4-8a57-757460bb66f4 req-385ce48a-dabf-4a27-8ce8-49beff54acee service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-vif-unplugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:32:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Instance destroyed successfully.
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.objects.instance [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'resources' on Instance uuid e6f39c99-9d07-4784-ab41-245408d9ff0a {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-250864351',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-250864351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-250864351',id=43,image_ref='28cdb3f3-b6cb-423f-8009-2d0d0104163d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbihZhOxNxVpi1x0+DDjjpYzzAkBkH5pHxk1pbG9QyQ/WMIjlhBtf70iyXmzmSSQDx+8mbsrfw7WJMy4ibYfAenClpMyTlIqIpNnpGqHdfgtVZWDg//yt7X10MYrrKfHw==',key_name='tempest-keypair-1069166463',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-5tq0lyft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2072234131',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=e6f39c99-9d07-4784-ab41-245408d9ff0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "address": "fa:16:3e:d5:f7:2a", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b31a6d4-e4", "ovs_interfaceid": "8b31a6d4-e4b5-478f-8546-a978e307ef60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_vif [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b31a6d4-e4, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc2841b8-3a17-422e-8f02-ebb5fa60442f) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:31 user nova-compute[74429]: INFO os_vif [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f7:2a,bridge_name='br-int',has_traffic_filtering=True,id=8b31a6d4-e4b5-478f-8546-a978e307ef60,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b31a6d4-e4')
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQrXVzxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:32:31 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5f617-20f9-4baa-8418-ca70e5b54bfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:32:31 user nova-compute[74429]: No targets found.
Oct 23 20:32:31 user nova-compute[74429]: iSNS:
Oct 23 20:32:31 user nova-compute[74429]: No targets found.
Oct 23 20:32:31 user nova-compute[74429]: STATIC:
Oct 23 20:32:31 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04
Oct 23 20:32:31 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:32:31 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:32:31 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:32:31 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:32:31 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:32:31 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc
Oct 23 20:32:31 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:32:31 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:32:31 user nova-compute[74429]: FIRMWARE:
Oct 23 20:32:31 user nova-compute[74429]: No targets found.
Oct 23 20:32:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:32:31 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:32:31 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[96301eee-c891-4f26-9ddc-9fe1ce90d8ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[870280f9-9ab2-4751-94ed-48485c735e19]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:32:31 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:32:31 user nova-compute[74429]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)
Oct 23 20:32:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:32:31 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:32:31 user nova-compute[74429]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 (non-flash)
Oct 23 20:32:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c6cb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8059f711-64cf-4edd-910a-06961d6c3ad6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e219bf4-4857-453c-bcda-91c76052d6fa]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb85082-85a6-4384-a7e8-a125fb4d6087]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea5a3c3-4935-43ff-b038-17806e1d04d0]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1114da3e-5aa5700b4a066ed1',) {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:32:31 user nova-compute[74429]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1114da3e-5aa5700b4a066ed1
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fa57ee-8224-43ae-b9b7-4fbaf005e8b5]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f90bae8-c49f-4bd6-898d-28394acefe9a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98ea4da-30d4-45e5-85ae-92765baefd16]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260]
Oct 23 20:32:31 user nova-compute[74429]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04, portal: 172.16.0.220,3260] successful.
Oct 23 20:32:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:402e3d81-582d-4e5e-8039-7ffb06858c04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce622ad9-42d4-4fa4-aa36-f6036fac6c34]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== disconnect_volume: return (321ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:32:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Deleting instance files /opt/stack/data/nova/instances/e6f39c99-9d07-4784-ab41-245408d9ff0a_del
Oct 23 20:32:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Deletion of /opt/stack/data/nova/instances/e6f39c99-9d07-4784-ab41-245408d9ff0a_del complete
Oct 23 20:32:31 user nova-compute[74429]: INFO nova.compute.manager [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 23 20:32:31 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:32:31 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:32:32 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:32:32 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Took 0.75 seconds to deallocate network for instance.
Oct 23 20:32:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-a4707ca2-e808-43cd-b018-0c238877b46d req-5074ac68-9849-4950-99e2-aecfaf64cfec service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-vif-deleted-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-ffdd86ed-871e-470e-b970-695d46cf25b0 req-f3f6901d-022d-47f9-999f-8533e28067aa service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received event network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ffdd86ed-871e-470e-b970-695d46cf25b0 req-f3f6901d-022d-47f9-999f-8533e28067aa service nova] Acquiring lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ffdd86ed-871e-470e-b970-695d46cf25b0 req-f3f6901d-022d-47f9-999f-8533e28067aa service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ffdd86ed-871e-470e-b970-695d46cf25b0 req-f3f6901d-022d-47f9-999f-8533e28067aa service nova] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-ffdd86ed-871e-470e-b970-695d46cf25b0 req-f3f6901d-022d-47f9-999f-8533e28067aa service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] No waiting events found dispatching network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:32:32 user nova-compute[74429]: WARNING nova.compute.manager [req-ffdd86ed-871e-470e-b970-695d46cf25b0 req-f3f6901d-022d-47f9-999f-8533e28067aa service nova] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Received unexpected event network-vif-plugged-8b31a6d4-e4b5-478f-8546-a978e307ef60 for instance with vm_state active and task_state deleting.
Oct 23 20:32:33 user nova-compute[74429]: INFO nova.compute.manager [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Took 0.85 seconds to detach 1 volumes for instance.
Oct 23 20:32:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: e6f39c99-9d07-4784-ab41-245408d9ff0a] Deleting volume: 402e3d81-582d-4e5e-8039-7ffb06858c04 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 20:32:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:33 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:32:33 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:32:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:33 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Deleted allocations for instance e6f39c99-9d07-4784-ab41-245408d9ff0a
Oct 23 20:32:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-60f79436-6b2f-48e0-a73e-5f73c770e048 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "e6f39c99-9d07-4784-ab41-245408d9ff0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.233s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:32:34 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c7005a2-402e-46c5-be64-9978443cdf0d is timed out.
Oct 23 20:32:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully detached device vdb from instance 5c7005a2-402e-46c5-be64-9978443cdf0d from the live domain config.
Oct 23 20:32:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzNrhsjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:32:35 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f41e8-9d05-4bdb-8045-74b1aa76162f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:32:35 user nova-compute[74429]: No targets found.
Oct 23 20:32:35 user nova-compute[74429]: iSNS:
Oct 23 20:32:35 user nova-compute[74429]: No targets found.
Oct 23 20:32:35 user nova-compute[74429]: STATIC:
Oct 23 20:32:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:32:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:32:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:32:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc
Oct 23 20:32:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:32:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:32:35 user nova-compute[74429]: FIRMWARE:
Oct 23 20:32:35 user nova-compute[74429]: No targets found.
Oct 23 20:32:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:32:35 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:32:35 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[35722642-61e0-428f-b1d1-d676b2464e10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7704cc-a389-4e4a-881d-606e1562c771]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:32:35 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:32:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:32:35 user nova-compute[74429]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc (non-flash)
Oct 23 20:32:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d5035c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc'): ({'sde'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Removing single pathed devices sde {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fafa7f-d723-45a9-b0be-8bab18f1942e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6caa41-d411-48f4-8cd5-afc09da76881]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flushing IO for device /dev/sde {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d13f5ff-e3c2-45f5-b87b-e15443efdfa6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a060e147-8126-41c6-9b15-21badbcd9327]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] SCSI volumes sde have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6f9b9b-cfba-49e0-95f7-b3ce3a3e001f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b9d092-1ca6-49d6-81cc-28e47d634b0b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260]
Oct 23 20:32:35 user nova-compute[74429]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc, portal: 172.16.0.220,3260] successful.
Oct 23 20:32:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560de346-d33e-4d72-9db7-06815574dfbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[37941252-8fa1-4109-a154-29083bb8e62d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== disconnect_volume: return (309ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:32:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:32:36 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:32:36 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=25.24211883544922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 2518683a-1e9b-4b01-9016-926336496b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 5c7005a2-402e-46c5-be64-9978443cdf0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 581e7447-603c-49ce-90e3-be01d76865f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:36 user nova-compute[74429]: INFO nova.compute.manager [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Terminating instance
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e7e72e2-1638-4c28-b869-a3ea4d606657 req-2b2047c2-ca09-4018-a585-f8a0da1ed905 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-unplugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e7e72e2-1638-4c28-b869-a3ea4d606657 req-2b2047c2-ca09-4018-a585-f8a0da1ed905 service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e7e72e2-1638-4c28-b869-a3ea4d606657 req-2b2047c2-ca09-4018-a585-f8a0da1ed905 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e7e72e2-1638-4c28-b869-a3ea4d606657 req-2b2047c2-ca09-4018-a585-f8a0da1ed905 service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e7e72e2-1638-4c28-b869-a3ea4d606657 req-2b2047c2-ca09-4018-a585-f8a0da1ed905 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-unplugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e7e72e2-1638-4c28-b869-a3ea4d606657 req-2b2047c2-ca09-4018-a585-f8a0da1ed905 service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-unplugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.objects.instance [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid 5c7005a2-402e-46c5-be64-9978443cdf0d {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:32:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-fdc2884f-a7ea-4593-b3a5-850db715e2f2 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Instance destroyed successfully.
Oct 23 20:32:36 user nova-compute[74429]: DEBUG nova.objects.instance [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'resources' on Instance uuid 2518683a-1e9b-4b01-9016-926336496b5f {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1278903747',display_name='tempest-TestMinimumBasicScenario-server-1278903747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1278903747',id=39,image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVOu61QiuMOdhKgN23vTwIBy3ZDi/QNDbNem0dxxsQ5MvbHXsvaF8Qm9i7aYGoWDJbi34Pu/Qb2QmK1TmvOvfaf0I2gaMQloC9SU+lPc33jCOZoWhlwPv6lRvXE8O6iw==',key_name='tempest-TestMinimumBasicScenario-1983512050',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-5uco920c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94af6c0e-d7e9-454b-8ee8-85710969888c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:29:52Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=2518683a-1e9b-4b01-9016-926336496b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "address": "fa:16:3e:9e:7a:d6", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e7e5fc-0c", "ovs_interfaceid": "28e7e5fc-0cca-43ff-871e-bf30593b788e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG os_vif [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e7e5fc-0c, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f171bc5-9841-4abb-890b-33514e3084e1) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:37 user nova-compute[74429]: INFO os_vif [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=28e7e5fc-0cca-43ff-871e-bf30593b788e,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e7e5fc-0c')
Oct 23 20:32:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Deleting instance files /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f_del
Oct 23 20:32:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Deletion of /opt/stack/data/nova/instances/2518683a-1e9b-4b01-9016-926336496b5f_del complete
Oct 23 20:32:37 user nova-compute[74429]: INFO nova.compute.manager [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 23 20:32:37 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:32:37 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Took 0.60 seconds to deallocate network for instance.
Oct 23 20:32:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:32:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:38 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Deleted allocations for instance 2518683a-1e9b-4b01-9016-926336496b5f
Oct 23 20:32:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-b397c9db-7de5-461e-94ab-c7e5d645831c tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "2518683a-1e9b-4b01-9016-926336496b5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.884s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] Acquiring lock "2518683a-1e9b-4b01-9016-926336496b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:32:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:32:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] Lock "2518683a-1e9b-4b01-9016-926336496b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:32:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] No waiting events found dispatching network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:32:38 user nova-compute[74429]: WARNING nova.compute.manager [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received unexpected event network-vif-plugged-28e7e5fc-0cca-43ff-871e-bf30593b788e for instance with vm_state deleted and task_state None.
Oct 23 20:32:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-2324e785-778c-467f-a246-7063d3f0c26b req-ce775d79-289c-4feb-8d8d-923e484c29df service nova] [instance: 2518683a-1e9b-4b01-9016-926336496b5f] Received event network-vif-deleted-28e7e5fc-0cca-43ff-871e-bf30593b788e {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:32:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:32:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:32:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:32:42 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:32:43 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating instance_info_cache with network_info: [{"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:32:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-5c7005a2-402e-46c5-be64-9978443cdf0d" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:32:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:32:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:32:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:32:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:32:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:32:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:33:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:33:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:33:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:05 user nova-compute[74429]: INFO nova.compute.manager [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Terminating instance
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-19415c39-8af6-4067-9047-a8b016ee17e5 req-555bee43-d569-46aa-bbf0-8e2cd7d39b3f service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-vif-unplugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19415c39-8af6-4067-9047-a8b016ee17e5 req-555bee43-d569-46aa-bbf0-8e2cd7d39b3f service nova] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19415c39-8af6-4067-9047-a8b016ee17e5 req-555bee43-d569-46aa-bbf0-8e2cd7d39b3f service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-19415c39-8af6-4067-9047-a8b016ee17e5 req-555bee43-d569-46aa-bbf0-8e2cd7d39b3f service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-19415c39-8af6-4067-9047-a8b016ee17e5 req-555bee43-d569-46aa-bbf0-8e2cd7d39b3f service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] No waiting events found dispatching network-vif-unplugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-19415c39-8af6-4067-9047-a8b016ee17e5 req-555bee43-d569-46aa-bbf0-8e2cd7d39b3f service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-vif-unplugged-86c31d69-4b84-4dd9-a888-7f8df151244b for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:33:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Instance destroyed successfully.
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.objects.instance [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'resources' on Instance uuid 5c7005a2-402e-46c5-be64-9978443cdf0d {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1036379341',display_name='tempest-AttachVolumeNegativeTest-server-1036379341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1036379341',id=40,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOA6RmvZDj9ggNHxyuiZZFDD90Yd+w/6TEuR+TJyGjFjO5qn+e7WDwB6eCZ7CkMBvaXdflu5qYuQFeNu5nHVGSS+KvesQVATPj6+sBlkGrrF8VBrqIQBUVqV/Vxgn9KOw==',key_name='tempest-keypair-1312615786',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:27:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-jikhtxh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=5c7005a2-402e-46c5-be64-9978443cdf0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "86c31d69-4b84-4dd9-a888-7f8df151244b", "address": "fa:16:3e:b2:b9:97", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c31d69-4b", "ovs_interfaceid": "86c31d69-4b84-4dd9-a888-7f8df151244b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG os_vif [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86c31d69-4b, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47d6f502-cc6d-48bf-949b-489d9c1a0b53) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:05 user nova-compute[74429]: INFO os_vif [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:b9:97,bridge_name='br-int',has_traffic_filtering=True,id=86c31d69-4b84-4dd9-a888-7f8df151244b,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c31d69-4b')
Oct 23 20:33:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Deleting instance files /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d_del
Oct 23 20:33:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Deletion of /opt/stack/data/nova/instances/5c7005a2-402e-46c5-be64-9978443cdf0d_del complete
Oct 23 20:33:05 user nova-compute[74429]: INFO nova.compute.manager [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 23 20:33:05 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:33:05 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:33:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:33:06 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Took 0.58 seconds to deallocate network for instance.
Oct 23 20:33:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:06 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:33:06 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:33:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:06 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Deleted allocations for instance 5c7005a2-402e-46c5-be64-9978443cdf0d
Oct 23 20:33:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-19685a0d-8408-4600-b5a6-c0547d1732f9 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.722s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] Acquiring lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] Lock "5c7005a2-402e-46c5-be64-9978443cdf0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] No waiting events found dispatching network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:33:07 user nova-compute[74429]: WARNING nova.compute.manager [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received unexpected event network-vif-plugged-86c31d69-4b84-4dd9-a888-7f8df151244b for instance with vm_state deleted and task_state None.
Oct 23 20:33:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-7801ba80-52f7-4549-a832-8bd2291cd71d req-2ae30345-9e43-4e6f-bc85-c9e4e46c08b4 service nova] [instance: 5c7005a2-402e-46c5-be64-9978443cdf0d] Received event network-vif-deleted-86c31d69-4b84-4dd9-a888-7f8df151244b {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:33:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:33:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:33:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:33:30 user nova-compute[74429]: INFO nova.compute.claims [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Claim successful on node user
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "581e7447-603c-49ce-90e3-be01d76865f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:30 user nova-compute[74429]: INFO nova.compute.manager [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Terminating instance
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e564d56-c976-4ce3-837e-da4e6b64452a req-3d6e227a-b2c9-4d6f-aa8c-b8e4aabf3023 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-vif-unplugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e564d56-c976-4ce3-837e-da4e6b64452a req-3d6e227a-b2c9-4d6f-aa8c-b8e4aabf3023 service nova] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e564d56-c976-4ce3-837e-da4e6b64452a req-3d6e227a-b2c9-4d6f-aa8c-b8e4aabf3023 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5e564d56-c976-4ce3-837e-da4e6b64452a req-3d6e227a-b2c9-4d6f-aa8c-b8e4aabf3023 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e564d56-c976-4ce3-837e-da4e6b64452a req-3d6e227a-b2c9-4d6f-aa8c-b8e4aabf3023 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] No waiting events found dispatching network-vif-unplugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-5e564d56-c976-4ce3-837e-da4e6b64452a req-3d6e227a-b2c9-4d6f-aa8c-b8e4aabf3023 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-vif-unplugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:33:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.policy [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12045265f772493984fb3d041c8e9456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1ae5a56f0d49dfb7f0aa63f8ef19ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:33:30 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Creating image(s)
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "/opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "/opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "/opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "bdbff0521753d97f06ae30be7de2ac5c4f8b66c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "bdbff0521753d97f06ae30be7de2ac5c4f8b66c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.part --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Instance destroyed successfully.
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.objects.instance [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'resources' on Instance uuid 581e7447-603c-49ce-90e3-be01d76865f0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1297130464',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1297130464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1297130464',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRXue/H6nlj0pESviC/pDL3VuiyO605fhhQct05/nqkc/ABxrfPolbEkkZXc1qKEophrYcSiXw6fA0sVXysk3F33QSa5kAzofzAQe7JLJV+JLRBI+HjUvA5UNAjPMrXFw==',key_name='tempest-keypair-1883712077',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-qflbpcqe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:28:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=581e7447-603c-49ce-90e3-be01d76865f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "address": "fa:16:3e:27:1f:fe", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5709450-11", "ovs_interfaceid": "a5709450-110b-4f25-ac6f-0653bf54fdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_vif [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5709450-11, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd2c2016-db57-4421-ad76-0dcc640a0a3f) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:31 user nova-compute[74429]: INFO os_vif [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:1f:fe,bridge_name='br-int',has_traffic_filtering=True,id=a5709450-110b-4f25-ac6f-0653bf54fdc8,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5709450-11')
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlMVePnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:33:31 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ac640-53e9-4b24-a162-728ebd986d72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:33:31 user nova-compute[74429]: No targets found.
Oct 23 20:33:31 user nova-compute[74429]: iSNS:
Oct 23 20:33:31 user nova-compute[74429]: No targets found.
Oct 23 20:33:31 user nova-compute[74429]: STATIC:
Oct 23 20:33:31 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799
Oct 23 20:33:31 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:33:31 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:33:31 user nova-compute[74429]: FIRMWARE:
Oct 23 20:33:31 user nova-compute[74429]: No targets found.
Oct 23 20:33:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:33:31 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:33:31 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80eeab3-1901-4601-b35a-709c3f539aae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ea492-c408-471c-8cca-e59eb8ae6f15]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:33:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 (non-flash)
Oct 23 20:33:31 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50598d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.part --force-share --output=json" returned: 0 in 0.230s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.virt.images [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] 51fc440e-0c91-430d-8419-577aaf5e4fc8 was qcow2, converting to raw {{(pid=74429) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.privsep.utils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74429) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.part /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.converted {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Successfully created port: cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[31541aeb-e70d-4771-9362-25c747cc1c6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a1363-5e8d-4c09-b43e-6ee6d13444f5]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e0269-9aaf-464c-9a9a-1f7f3dfdac8b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:33:31 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.252s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbe9ccc-c086-4add-908d-ed04b64e005d]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d3031c-ff78-4d7e-a247-aeeb25944f63]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8023a8f-a1ad-4bb1-b6fd-5aef9dd973ac]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260]
Oct 23 20:33:32 user nova-compute[74429]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799, portal: 172.16.0.220,3260] successful.
Oct 23 20:33:32 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c809d5-d448-4f96-8060-382c654e8799 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[349d137c-bea3-4354-91db-c65059c79c13]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.595s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== disconnect_volume: return (597ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:33:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Deleting instance files /opt/stack/data/nova/instances/581e7447-603c-49ce-90e3-be01d76865f0_del
Oct 23 20:33:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Deletion of /opt/stack/data/nova/instances/581e7447-603c-49ce-90e3-be01d76865f0_del complete
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.part /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.converted" returned: 0 in 0.535s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.converted --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: INFO nova.compute.manager [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Took 1.82 seconds to destroy the instance on the hypervisor.
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "bdbff0521753d97f06ae30be7de2ac5c4f8b66c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.476s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Successfully updated port: cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "bdbff0521753d97f06ae30be7de2ac5c4f8b66c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "bdbff0521753d97f06ae30be7de2ac5c4f8b66c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] Acquiring lock "581e7447-603c-49ce-90e3-be01d76865f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] Lock "581e7447-603c-49ce-90e3-be01d76865f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] No waiting events found dispatching network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:33:32 user nova-compute[74429]: WARNING nova.compute.manager [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received unexpected event network-vif-plugged-a5709450-110b-4f25-ac6f-0653bf54fdc8 for instance with vm_state active and task_state deleting.
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing instance network info cache due to event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7,backing_fmt=raw /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance network_info: |[{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG nova.network.neutron [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7,backing_fmt=raw /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk 1073741824" returned: 0 in 0.053s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "bdbff0521753d97f06ae30be7de2ac5c4f8b66c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Cannot resize image /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Ensure instance console log exists: /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Start _get_guest_xml network_info=[{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T20:33:28Z,direct_url=<?>,disk_format='qcow2',id=51fc440e-0c91-430d-8419-577aaf5e4fc8,min_disk=0,min_ram=0,name='tempest-scenario-img--342534232',owner='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T20:33:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '51fc440e-0c91-430d-8419-577aaf5e4fc8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:33:33 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:33:33 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:33:33 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Took 0.97 seconds to deallocate network for instance.
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T20:33:28Z,direct_url=<?>,disk_format='qcow2',id=51fc440e-0c91-430d-8419-577aaf5e4fc8,min_disk=0,min_ram=0,name='tempest-scenario-img--342534232',owner='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T20:33:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1454507172',display_name='tempest-TestMinimumBasicScenario-server-1454507172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1454507172',id=44,image_ref='51fc440e-0c91-430d-8419-577aaf5e4fc8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXnNhpO8i7LOeo9mVcR4Mikq2bgheZ6A3NGJQQiE8Ipro8QVgRqhlUasi0vVZU0/2MH2nkd3laqGHemRAzs+0CVRTO35twQNz5RuVwzGGDEe0M56pr9T2WXVHofT+jI8g==',key_name='tempest-TestMinimumBasicScenario-317315725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-w1cchh2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51fc440e-0c91-430d-8419-577aaf5e4fc8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:33:31Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=d23ce6b0-370f-44b3-9d43-296be032b411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.objects.instance [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'pci_devices' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:33:33 user nova-compute[74429]:   <uuid>d23ce6b0-370f-44b3-9d43-296be032b411</uuid>
Oct 23 20:33:33 user nova-compute[74429]:   <name>instance-0000002c</name>
Oct 23 20:33:33 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:33:33 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:33:33 user nova-compute[74429]:   <metadata>
Oct 23 20:33:33 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:33:33 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:33:33 user nova-compute[74429]:       <nova:name>tempest-TestMinimumBasicScenario-server-1454507172</nova:name>
Oct 23 20:33:33 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:33:33</nova:creationTime>
Oct 23 20:33:33 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:33:33 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:33:33 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:33:33 user nova-compute[74429]:       <nova:owner>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:user uuid="12045265f772493984fb3d041c8e9456">tempest-TestMinimumBasicScenario-1495059245-project-member</nova:user>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:project uuid="8b1ae5a56f0d49dfb7f0aa63f8ef19ec">tempest-TestMinimumBasicScenario-1495059245</nova:project>
Oct 23 20:33:33 user nova-compute[74429]:       </nova:owner>
Oct 23 20:33:33 user nova-compute[74429]:       <nova:root type="image" uuid="51fc440e-0c91-430d-8419-577aaf5e4fc8"/>
Oct 23 20:33:33 user nova-compute[74429]:       <nova:ports>
Oct 23 20:33:33 user nova-compute[74429]:         <nova:port uuid="cd809d0b-09e2-40a5-8e36-8bb8751efdc5">
Oct 23 20:33:33 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:33:33 user nova-compute[74429]:         </nova:port>
Oct 23 20:33:33 user nova-compute[74429]:       </nova:ports>
Oct 23 20:33:33 user nova-compute[74429]:     </nova:instance>
Oct 23 20:33:33 user nova-compute[74429]:   </metadata>
Oct 23 20:33:33 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:33:33 user nova-compute[74429]:     <system>
Oct 23 20:33:33 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:33:33 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:33:33 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:33:33 user nova-compute[74429]:       <entry name="serial">d23ce6b0-370f-44b3-9d43-296be032b411</entry>
Oct 23 20:33:33 user nova-compute[74429]:       <entry name="uuid">d23ce6b0-370f-44b3-9d43-296be032b411</entry>
Oct 23 20:33:33 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:33:33 user nova-compute[74429]:     </system>
Oct 23 20:33:33 user nova-compute[74429]:   </sysinfo>
Oct 23 20:33:33 user nova-compute[74429]:   <os>
Oct 23 20:33:33 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:33:33 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:33:33 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:33:33 user nova-compute[74429]:   </os>
Oct 23 20:33:33 user nova-compute[74429]:   <features>
Oct 23 20:33:33 user nova-compute[74429]:     <acpi/>
Oct 23 20:33:33 user nova-compute[74429]:     <apic/>
Oct 23 20:33:33 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:33:33 user nova-compute[74429]:   </features>
Oct 23 20:33:33 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:33:33 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:33:33 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:33:33 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:33:33 user nova-compute[74429]:   </clock>
Oct 23 20:33:33 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:33:33 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:33:33 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:33:33 user nova-compute[74429]:   </cpu>
Oct 23 20:33:33 user nova-compute[74429]:   <devices>
Oct 23 20:33:33 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:33:33 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:33:33 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk"/>
Oct 23 20:33:33 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:33:33 user nova-compute[74429]:     </disk>
Oct 23 20:33:33 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:33:33 user nova-compute[74429]:       <mac address="fa:16:3e:7b:1b:39"/>
Oct 23 20:33:33 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:33:33 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:33:33 user nova-compute[74429]:       <target dev="tapcd809d0b-09"/>
Oct 23 20:33:33 user nova-compute[74429]:     </interface>
Oct 23 20:33:33 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:33:33 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/console.log" append="off"/>
Oct 23 20:33:33 user nova-compute[74429]:     </serial>
Oct 23 20:33:33 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:33:33 user nova-compute[74429]:     <video>
Oct 23 20:33:33 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:33:33 user nova-compute[74429]:     </video>
Oct 23 20:33:33 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:33:33 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:33:33 user nova-compute[74429]:     </rng>
Oct 23 20:33:33 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:33:33 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:33:33 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:33:33 user nova-compute[74429]:     </memballoon>
Oct 23 20:33:33 user nova-compute[74429]:   </devices>
Oct 23 20:33:33 user nova-compute[74429]: </domain>
Oct 23 20:33:33 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1454507172',display_name='tempest-TestMinimumBasicScenario-server-1454507172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1454507172',id=44,image_ref='51fc440e-0c91-430d-8419-577aaf5e4fc8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXnNhpO8i7LOeo9mVcR4Mikq2bgheZ6A3NGJQQiE8Ipro8QVgRqhlUasi0vVZU0/2MH2nkd3laqGHemRAzs+0CVRTO35twQNz5RuVwzGGDEe0M56pr9T2WXVHofT+jI8g==',key_name='tempest-TestMinimumBasicScenario-317315725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-w1cchh2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51fc440e-0c91-430d-8419-577aaf5e4fc8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:33:31Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=d23ce6b0-370f-44b3-9d43-296be032b411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG os_vif [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7df223f-b201-557c-a3d4-989b26df60a2', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-9e58f1bb-6c96-4bf4-96ba-9a38f29c80ac req-0876b6ad-73c6-42a8-aa7f-acae539c58e4 service nova] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Received event network-vif-deleted-a5709450-110b-4f25-ac6f-0653bf54fdc8 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd809d0b-09, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd809d0b-09, col_values=(('qos', UUID('1a70b5ed-c16d-4573-a389-86f719869a5f')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd809d0b-09, col_values=(('external_ids', {'iface-id': 'cd809d0b-09e2-40a5-8e36-8bb8751efdc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:1b:39', 'vm-uuid': 'd23ce6b0-370f-44b3-9d43-296be032b411'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:33 user nova-compute[74429]: INFO os_vif [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09')
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No VIF found with MAC fa:16:3e:7b:1b:39, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated VIF entry in instance network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:33:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5912bbb-48cf-405e-9b53-c813b337d600 req-7a1cca34-e582-4d96-93f6-2f662ec94b49 service nova] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:33:34 user nova-compute[74429]: INFO nova.compute.manager [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Took 0.88 seconds to detach 1 volumes for instance.
Oct 23 20:33:34 user nova-compute[74429]: DEBUG nova.compute.manager [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 581e7447-603c-49ce-90e3-be01d76865f0] Deleting volume: b9c809d5-d448-4f96-8060-382c654e8799 {{(pid=74429) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:34 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Deleted allocations for instance 581e7447-603c-49ce-90e3-be01d76865f0
Oct 23 20:33:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-15a0c4ee-4b3a-4e8f-968d-87afcaee6a6b tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "581e7447-603c-49ce-90e3-be01d76865f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.075s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:33:35 user nova-compute[74429]: WARNING nova.compute.manager [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state building and task_state spawning.
Oct 23 20:33:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG nova.compute.manager [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:33:35 user nova-compute[74429]: WARNING nova.compute.manager [req-2a649acf-700b-4633-a9eb-f4af4f6c325b req-dbc1b828-9291-4c4e-9ba4-9838cd753866 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state building and task_state spawning.
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:33:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:33:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance spawned successfully.
Oct 23 20:33:37 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:33:37 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=25.267311096191406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:33:37 user nova-compute[74429]: INFO nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Took 6.72 seconds to spawn the instance on the hypervisor.
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:33:37 user nova-compute[74429]: INFO nova.compute.manager [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Took 7.39 seconds to build instance.
Oct 23 20:33:37 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:37 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-d84528df-b744-48cf-981e-4f034d8be7a8 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.499s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:33:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:33:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:33:48 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:33:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:33:58 user nova-compute[74429]: INFO nova.compute.claims [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Claim successful on node user
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:33:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:33:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:33:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Creating image(s)
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "/opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.037s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.policy [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0276e322764c476dae32a7972c7851fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3ab94102b4496082c15d4ec466eb0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk 1073741824" returned: 0 in 0.053s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Successfully created port: fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Cannot resize image /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Ensure instance console log exists: /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:33:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Successfully updated port: fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquired lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-changed-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Refreshing instance network info cache due to event network-changed-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] Acquiring lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating instance_info_cache with network_info: [{"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Releasing lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Instance network_info: |[{"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] Acquired lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.neutron [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Refreshing network info cache for port fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Start _get_guest_xml network_info=[{"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:34:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:34:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1084061467',display_name='tempest-AttachVolumeNegativeTest-server-1084061467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1084061467',id=45,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDorPdud4ZRbwnXrX7FxHaEKOv2+cj/qbJh7S5FEMzg9A09ckjHQFQWxBrgbjCcZT5qj2JgMhcgXuVGZuBdyU/bPFlJRXhiCCf7MZLln6LfE04iDkzTSBsK4OwBp7WIf1A==',key_name='tempest-keypair-1151786925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-erj7z8zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=14889a96-fe7e-4a24-8957-f317d9ffe5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'pci_devices' on Instance uuid 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:34:00 user nova-compute[74429]:   <uuid>14889a96-fe7e-4a24-8957-f317d9ffe5c0</uuid>
Oct 23 20:34:00 user nova-compute[74429]:   <name>instance-0000002d</name>
Oct 23 20:34:00 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:34:00 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:34:00 user nova-compute[74429]:   <metadata>
Oct 23 20:34:00 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:34:00 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:34:00 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1084061467</nova:name>
Oct 23 20:34:00 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:34:00</nova:creationTime>
Oct 23 20:34:00 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:34:00 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:34:00 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:34:00 user nova-compute[74429]:       <nova:owner>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:user uuid="0276e322764c476dae32a7972c7851fd">tempest-AttachVolumeNegativeTest-1373844485-project-member</nova:user>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:project uuid="5e3ab94102b4496082c15d4ec466eb0f">tempest-AttachVolumeNegativeTest-1373844485</nova:project>
Oct 23 20:34:00 user nova-compute[74429]:       </nova:owner>
Oct 23 20:34:00 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:34:00 user nova-compute[74429]:       <nova:ports>
Oct 23 20:34:00 user nova-compute[74429]:         <nova:port uuid="fb357bee-a0e2-4cf4-99a1-2df4ae8bada9">
Oct 23 20:34:00 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 20:34:00 user nova-compute[74429]:         </nova:port>
Oct 23 20:34:00 user nova-compute[74429]:       </nova:ports>
Oct 23 20:34:00 user nova-compute[74429]:     </nova:instance>
Oct 23 20:34:00 user nova-compute[74429]:   </metadata>
Oct 23 20:34:00 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:34:00 user nova-compute[74429]:     <system>
Oct 23 20:34:00 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:34:00 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:34:00 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:34:00 user nova-compute[74429]:       <entry name="serial">14889a96-fe7e-4a24-8957-f317d9ffe5c0</entry>
Oct 23 20:34:00 user nova-compute[74429]:       <entry name="uuid">14889a96-fe7e-4a24-8957-f317d9ffe5c0</entry>
Oct 23 20:34:00 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:34:00 user nova-compute[74429]:     </system>
Oct 23 20:34:00 user nova-compute[74429]:   </sysinfo>
Oct 23 20:34:00 user nova-compute[74429]:   <os>
Oct 23 20:34:00 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:34:00 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:34:00 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:34:00 user nova-compute[74429]:   </os>
Oct 23 20:34:00 user nova-compute[74429]:   <features>
Oct 23 20:34:00 user nova-compute[74429]:     <acpi/>
Oct 23 20:34:00 user nova-compute[74429]:     <apic/>
Oct 23 20:34:00 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:34:00 user nova-compute[74429]:   </features>
Oct 23 20:34:00 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:34:00 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:34:00 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:34:00 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:34:00 user nova-compute[74429]:   </clock>
Oct 23 20:34:00 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:34:00 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:34:00 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:34:00 user nova-compute[74429]:   </cpu>
Oct 23 20:34:00 user nova-compute[74429]:   <devices>
Oct 23 20:34:00 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:34:00 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:34:00 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk"/>
Oct 23 20:34:00 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:34:00 user nova-compute[74429]:     </disk>
Oct 23 20:34:00 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:34:00 user nova-compute[74429]:       <mac address="fa:16:3e:d4:1a:a2"/>
Oct 23 20:34:00 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:34:00 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:34:00 user nova-compute[74429]:       <target dev="tapfb357bee-a0"/>
Oct 23 20:34:00 user nova-compute[74429]:     </interface>
Oct 23 20:34:00 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:34:00 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/console.log" append="off"/>
Oct 23 20:34:00 user nova-compute[74429]:     </serial>
Oct 23 20:34:00 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:34:00 user nova-compute[74429]:     <video>
Oct 23 20:34:00 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:34:00 user nova-compute[74429]:     </video>
Oct 23 20:34:00 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:34:00 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:34:00 user nova-compute[74429]:     </rng>
Oct 23 20:34:00 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:34:00 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:34:00 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:34:00 user nova-compute[74429]:     </memballoon>
Oct 23 20:34:00 user nova-compute[74429]:   </devices>
Oct 23 20:34:00 user nova-compute[74429]: </domain>
Oct 23 20:34:00 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1084061467',display_name='tempest-AttachVolumeNegativeTest-server-1084061467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1084061467',id=45,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDorPdud4ZRbwnXrX7FxHaEKOv2+cj/qbJh7S5FEMzg9A09ckjHQFQWxBrgbjCcZT5qj2JgMhcgXuVGZuBdyU/bPFlJRXhiCCf7MZLln6LfE04iDkzTSBsK4OwBp7WIf1A==',key_name='tempest-keypair-1151786925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-erj7z8zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=14889a96-fe7e-4a24-8957-f317d9ffe5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG os_vif [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9c47f1c-1aa0-5392-b97c-80c74714cc43', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb357bee-a0, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb357bee-a0, col_values=(('qos', UUID('c4ee7cfc-1f6f-4d91-9bb9-f46c87df1866')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb357bee-a0, col_values=(('external_ids', {'iface-id': 'fb357bee-a0e2-4cf4-99a1-2df4ae8bada9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:1a:a2', 'vm-uuid': '14889a96-fe7e-4a24-8957-f317d9ffe5c0'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:00 user nova-compute[74429]: INFO os_vif [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0')
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:34:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:d4:1a:a2, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:34:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updated VIF entry in instance network info cache for port fb357bee-a0e2-4cf4-99a1-2df4ae8bada9. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:34:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating instance_info_cache with network_info: [{"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:34:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6715f1b4-f45b-44ef-9bef-c38b550abe0f req-d8c630da-7fae-4941-b6b3-c61e48b5cb1a service nova] Releasing lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:34:01 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-949e3470-383a-4e4f-8edb-997942df599a req-a22ff6d4-edb4-4b0e-9e74-a879c791372d service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-949e3470-383a-4e4f-8edb-997942df599a req-a22ff6d4-edb4-4b0e-9e74-a879c791372d service nova] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-949e3470-383a-4e4f-8edb-997942df599a req-a22ff6d4-edb4-4b0e-9e74-a879c791372d service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-949e3470-383a-4e4f-8edb-997942df599a req-a22ff6d4-edb4-4b0e-9e74-a879c791372d service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-949e3470-383a-4e4f-8edb-997942df599a req-a22ff6d4-edb4-4b0e-9e74-a879c791372d service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] No waiting events found dispatching network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:34:02 user nova-compute[74429]: WARNING nova.compute.manager [req-949e3470-383a-4e4f-8edb-997942df599a req-a22ff6d4-edb4-4b0e-9e74-a879c791372d service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received unexpected event network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 for instance with vm_state building and task_state spawning.
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:34:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Instance spawned successfully.
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:34:04 user nova-compute[74429]: INFO nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:34:04 user nova-compute[74429]: INFO nova.compute.manager [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Took 5.87 seconds to build instance.
Oct 23 20:34:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f169b537-fd61-49a4-8b59-c7c6fe17c95e tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.962s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-34fcfe05-a1e6-43a6-a455-4c180f708bc4 req-a4c788c6-f9a9-4e8e-9a44-6c7506148c9d service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-34fcfe05-a1e6-43a6-a455-4c180f708bc4 req-a4c788c6-f9a9-4e8e-9a44-6c7506148c9d service nova] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-34fcfe05-a1e6-43a6-a455-4c180f708bc4 req-a4c788c6-f9a9-4e8e-9a44-6c7506148c9d service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-34fcfe05-a1e6-43a6-a455-4c180f708bc4 req-a4c788c6-f9a9-4e8e-9a44-6c7506148c9d service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-34fcfe05-a1e6-43a6-a455-4c180f708bc4 req-a4c788c6-f9a9-4e8e-9a44-6c7506148c9d service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] No waiting events found dispatching network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:34:04 user nova-compute[74429]: WARNING nova.compute.manager [req-34fcfe05-a1e6-43a6-a455-4c180f708bc4 req-a4c788c6-f9a9-4e8e-9a44-6c7506148c9d service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received unexpected event network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 for instance with vm_state active and task_state None.
Oct 23 20:34:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:36 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:36 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:34:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:38 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:34:38 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=25.208824157714844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:34:38 user nova-compute[74429]: INFO nova.compute.claims [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Claim successful on node user
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:38 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:34:39 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:34:39 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:34:39 user nova-compute[74429]: INFO nova.virt.block_device [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Booting with volume a17d4369-5785-443e-9fa4-cfde03d5fe12 at /dev/vda
Oct 23 20:34:39 user nova-compute[74429]: DEBUG os_brick.utils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG nova.policy [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8399a03e24cd4cd7bbd8bdd9558d0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827ab59e22b4fa69f1475517e89727a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4b91a3-f103-4d90-982b-42fbf61eee4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[08addd88-9ac4-4304-b61f-d37268a35482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10fbe61-f9b0-4d7c-a42e-cef42da76f43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb2c29-cdc9-461c-9d88-40a2cd6bc1db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:34:39 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dce218-9ef8-4cc3-b2bd-1b6d45225931]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG os_brick.utils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updating existing volume attachment record: 56e5d45a-6664-4084-8d5b-b5fb77b4d70a {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:39 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Successfully created port: a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Successfully updated port: a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquired lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-changed-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.compute.manager [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Refreshing instance network info cache due to event network-changed-a4c24c57-cf5b-4378-9e8c-f169c4734a26. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] Acquiring lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updating instance_info_cache with network_info: [{"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Releasing lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Instance network_info: |[{"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] Acquired lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG nova.network.neutron [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Refreshing network info cache for port a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:34:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updated VIF entry in instance network info cache for port a4c24c57-cf5b-4378-9e8c-f169c4734a26. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:34:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updating instance_info_cache with network_info: [{"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:34:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fcb6a0ba-b566-409a-8476-4fd5f5dd9272 req-16d2d5e5-913a-45aa-af14-1e26e37cea42 service nova] Releasing lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:34:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Skipping network cache update for instance because it is Building. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:34:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:34:45 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:34:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:34:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:34:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:34:48 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:34:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:34:55 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Creating image(s)
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Ensure instance console log exists: /opt/stack/data/nova/instances/a7c09ee0-297b-49bb-b230-614b4d7e8349/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Start _get_guest_xml network_info=[{"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '56e5d45a-6664-4084-8d5b-b5fb77b4d70a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7c09ee0-297b-49bb-b230-614b4d7e8349', 'attached_at': '', 'detached_at': '', 'volume_id': 'a17d4369-5785-443e-9fa4-cfde03d5fe12', 'serial': 'a17d4369-5785-443e-9fa4-cfde03d5fe12'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:34:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:34:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:34:55 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:34:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:34:55 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:34:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:34:55 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:34:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec85ff79-ea6b-43c1-a6fa-f756f0637fb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:34:55 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77aa74-ea7e-4ace-8752-5cc3f2d5fd78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12] added
Oct 23 20:34:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f02f01-7d0b-49c9-aceb-510847320636]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[01538fd6-3ba9-47b6-b6cf-364bd7d9954a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqheJHxi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqheJHxi" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cdfe13-2713-4b48-babd-41fcfa833bfb]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FqheJHxi'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13a104-b3de-4832-8581-7bc96b36c868]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb155d0-bfcc-4a1b-846f-ca48f136e9f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:34:56 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:34:56 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:34:56 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:34:56 user nova-compute[74429]: 
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e65480-db95-4fd0-b514-878b4aef97c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]
Oct 23 20:34:56 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.
Oct 23 20:34:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aacfdb8-8517-48a0-9db8-2384d98d1d55]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb8f5f8-164b-4b74-aacf-15cb9df0cca1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:34:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:34:56 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17368c-5292-4436-97d8-914541097d27]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:34:56 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23537643265313933', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537643265313933', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-552599111',display_name='tempest-TestVolumeBootPattern-server-552599111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-552599111',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-thodtgjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:34:39Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=a7c09ee0-297b-49bb-b230-614b4d7e8349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'pci_devices' on Instance uuid a7c09ee0-297b-49bb-b230-614b4d7e8349 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:34:57 user nova-compute[74429]:   <uuid>a7c09ee0-297b-49bb-b230-614b4d7e8349</uuid>
Oct 23 20:34:57 user nova-compute[74429]:   <name>instance-0000002e</name>
Oct 23 20:34:57 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:34:57 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:34:57 user nova-compute[74429]:   <metadata>
Oct 23 20:34:57 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:34:57 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:34:57 user nova-compute[74429]:       <nova:name>tempest-TestVolumeBootPattern-server-552599111</nova:name>
Oct 23 20:34:57 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:34:55</nova:creationTime>
Oct 23 20:34:57 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:34:57 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:34:57 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:34:57 user nova-compute[74429]:       <nova:owner>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:user uuid="8399a03e24cd4cd7bbd8bdd9558d0798">tempest-TestVolumeBootPattern-2072234131-project-member</nova:user>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:project uuid="6827ab59e22b4fa69f1475517e89727a">tempest-TestVolumeBootPattern-2072234131</nova:project>
Oct 23 20:34:57 user nova-compute[74429]:       </nova:owner>
Oct 23 20:34:57 user nova-compute[74429]:       <nova:ports>
Oct 23 20:34:57 user nova-compute[74429]:         <nova:port uuid="a4c24c57-cf5b-4378-9e8c-f169c4734a26">
Oct 23 20:34:57 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 20:34:57 user nova-compute[74429]:         </nova:port>
Oct 23 20:34:57 user nova-compute[74429]:       </nova:ports>
Oct 23 20:34:57 user nova-compute[74429]:     </nova:instance>
Oct 23 20:34:57 user nova-compute[74429]:   </metadata>
Oct 23 20:34:57 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:34:57 user nova-compute[74429]:     <system>
Oct 23 20:34:57 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:34:57 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:34:57 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:34:57 user nova-compute[74429]:       <entry name="serial">a7c09ee0-297b-49bb-b230-614b4d7e8349</entry>
Oct 23 20:34:57 user nova-compute[74429]:       <entry name="uuid">a7c09ee0-297b-49bb-b230-614b4d7e8349</entry>
Oct 23 20:34:57 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:34:57 user nova-compute[74429]:     </system>
Oct 23 20:34:57 user nova-compute[74429]:   </sysinfo>
Oct 23 20:34:57 user nova-compute[74429]:   <os>
Oct 23 20:34:57 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:34:57 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:34:57 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:34:57 user nova-compute[74429]:   </os>
Oct 23 20:34:57 user nova-compute[74429]:   <features>
Oct 23 20:34:57 user nova-compute[74429]:     <acpi/>
Oct 23 20:34:57 user nova-compute[74429]:     <apic/>
Oct 23 20:34:57 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:34:57 user nova-compute[74429]:   </features>
Oct 23 20:34:57 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:34:57 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:34:57 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:34:57 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:34:57 user nova-compute[74429]:   </clock>
Oct 23 20:34:57 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:34:57 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:34:57 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:34:57 user nova-compute[74429]:   </cpu>
Oct 23 20:34:57 user nova-compute[74429]:   <devices>
Oct 23 20:34:57 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:34:57 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:34:57 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:34:57 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:34:57 user nova-compute[74429]:       <serial>a17d4369-5785-443e-9fa4-cfde03d5fe12</serial>
Oct 23 20:34:57 user nova-compute[74429]:     </disk>
Oct 23 20:34:57 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:34:57 user nova-compute[74429]:       <mac address="fa:16:3e:16:25:61"/>
Oct 23 20:34:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:34:57 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:34:57 user nova-compute[74429]:       <target dev="tapa4c24c57-cf"/>
Oct 23 20:34:57 user nova-compute[74429]:     </interface>
Oct 23 20:34:57 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:34:57 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/a7c09ee0-297b-49bb-b230-614b4d7e8349/console.log" append="off"/>
Oct 23 20:34:57 user nova-compute[74429]:     </serial>
Oct 23 20:34:57 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:34:57 user nova-compute[74429]:     <video>
Oct 23 20:34:57 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:34:57 user nova-compute[74429]:     </video>
Oct 23 20:34:57 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:34:57 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:34:57 user nova-compute[74429]:     </rng>
Oct 23 20:34:57 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:34:57 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:34:57 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:34:57 user nova-compute[74429]:     </memballoon>
Oct 23 20:34:57 user nova-compute[74429]:   </devices>
Oct 23 20:34:57 user nova-compute[74429]: </domain>
Oct 23 20:34:57 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-552599111',display_name='tempest-TestVolumeBootPattern-server-552599111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-552599111',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-thodtgjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:34:39Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=a7c09ee0-297b-49bb-b230-614b4d7e8349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG os_vif [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd12ba3cf-4594-5073-bb4b-14886b3c3f8d', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4c24c57-cf, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4c24c57-cf, col_values=(('qos', UUID('5f69104f-faa9-40ac-a328-6d3cc3a3da03')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4c24c57-cf, col_values=(('external_ids', {'iface-id': 'a4c24c57-cf5b-4378-9e8c-f169c4734a26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:25:61', 'vm-uuid': 'a7c09ee0-297b-49bb-b230-614b4d7e8349'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:57 user nova-compute[74429]: INFO os_vif [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf')
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:34:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No VIF found with MAC fa:16:3e:16:25:61, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-890befb9-21e5-4022-b60a-cf70b2a518ed req-6d9ca91d-8315-4822-9550-ac79a78c3775 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-890befb9-21e5-4022-b60a-cf70b2a518ed req-6d9ca91d-8315-4822-9550-ac79a78c3775 service nova] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-890befb9-21e5-4022-b60a-cf70b2a518ed req-6d9ca91d-8315-4822-9550-ac79a78c3775 service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-890befb9-21e5-4022-b60a-cf70b2a518ed req-6d9ca91d-8315-4822-9550-ac79a78c3775 service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:34:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-890befb9-21e5-4022-b60a-cf70b2a518ed req-6d9ca91d-8315-4822-9550-ac79a78c3775 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] No waiting events found dispatching network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:34:58 user nova-compute[74429]: WARNING nova.compute.manager [req-890befb9-21e5-4022-b60a-cf70b2a518ed req-6d9ca91d-8315-4822-9550-ac79a78c3775 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received unexpected event network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 for instance with vm_state building and task_state spawning.
Oct 23 20:34:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:34:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:35:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Instance spawned successfully.
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:35:00 user nova-compute[74429]: INFO nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Took 4.77 seconds to spawn the instance on the hypervisor.
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:35:00 user nova-compute[74429]: INFO nova.compute.manager [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Took 22.08 seconds to build instance.
Oct 23 20:35:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e72c48a2-0be8-4cbe-ae14-2b253e5f73d4 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.177s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-cf8b705e-5b3a-4048-b170-b1f52e79461b req-5bb6ae67-9375-4e7f-b8cb-d8cd6d805bfc service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cf8b705e-5b3a-4048-b170-b1f52e79461b req-5bb6ae67-9375-4e7f-b8cb-d8cd6d805bfc service nova] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cf8b705e-5b3a-4048-b170-b1f52e79461b req-5bb6ae67-9375-4e7f-b8cb-d8cd6d805bfc service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cf8b705e-5b3a-4048-b170-b1f52e79461b req-5bb6ae67-9375-4e7f-b8cb-d8cd6d805bfc service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-cf8b705e-5b3a-4048-b170-b1f52e79461b req-5bb6ae67-9375-4e7f-b8cb-d8cd6d805bfc service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] No waiting events found dispatching network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:35:00 user nova-compute[74429]: WARNING nova.compute.manager [req-cf8b705e-5b3a-4048-b170-b1f52e79461b req-5bb6ae67-9375-4e7f-b8cb-d8cd6d805bfc service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received unexpected event network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 for instance with vm_state active and task_state None.
Oct 23 20:35:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Verify base images {{(pid=74429) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74429) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Image id 2ada0c77-c749-4517-8f1f-639beb4e6c0a yields fingerprint 72b42852ed32ed225da6e714cfd9859b01201f9d {{(pid=74429) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 20:35:06 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] image 2ada0c77-c749-4517-8f1f-639beb4e6c0a at (/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d): checking
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] image 2ada0c77-c749-4517-8f1f-639beb4e6c0a at (/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d): image is in use {{(pid=74429) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Image id 51fc440e-0c91-430d-8419-577aaf5e4fc8 yields fingerprint bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 {{(pid=74429) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 20:35:06 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] image 51fc440e-0c91-430d-8419-577aaf5e4fc8 at (/opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7): checking
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] image 51fc440e-0c91-430d-8419-577aaf5e4fc8 at (/opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7): image is in use {{(pid=74429) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] a7c09ee0-297b-49bb-b230-614b4d7e8349 is a valid instance name {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] 14889a96-fe7e-4a24-8957-f317d9ffe5c0 is a valid instance name {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] 14889a96-fe7e-4a24-8957-f317d9ffe5c0 has a disk file {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 is backed by 72b42852ed32ed225da6e714cfd9859b01201f9d {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] d23ce6b0-370f-44b3-9d43-296be032b411 is a valid instance name {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] d23ce6b0-370f-44b3-9d43-296be032b411 has a disk file {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 20:35:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 is backed by bdbff0521753d97f06ae30be7de2ac5c4f8b66c7 {{(pid=74429) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394
Oct 23 20:35:07 user nova-compute[74429]: WARNING nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Active base files: /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d /opt/stack/data/nova/instances/_base/bdbff0521753d97f06ae30be7de2ac5c4f8b66c7
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Removable base files: /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302 /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11 /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113 /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394 /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eeac7f8b7ea3b5084933732dcd41e1e1535702ec
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04ace2f22f5e0233a05090b93fc2a9a3f6cc6302
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3182dc1202697089ddb2116c35d88ba414b2949d
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca18db206600093a0abacb15b4c872771fe08b11
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1a7194e8474272edd9aa7849d20d69b439ad7113
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da8cad8c63346c7642a1419dfe93f34f6fdf4394
Oct 23 20:35:07 user nova-compute[74429]: INFO nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/df94a9d75b3d9a0dd79c9ecdc65e3d715632f973
Oct 23 20:35:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Verification complete {{(pid=74429) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 23 20:35:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Verify swap images {{(pid=74429) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 23 20:35:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.imagecache [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Verify ephemeral images {{(pid=74429) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 23 20:35:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:35:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:35:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:35:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:35:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'flavor' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:26 user nova-compute[74429]: INFO nova.compute.manager [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Attaching volume 75040959-64aa-4b59-9af0-4b1f5c857d95 to /dev/vdb
Oct 23 20:35:26 user nova-compute[74429]: DEBUG os_brick.utils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67edc96-7c32-4682-9f34-60fdb04f10f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:26 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3162672-b14f-4a93-9cf9-63db3f8fa4d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3464ac-e472-4d1a-94ec-271ba8f70640]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0283b1e-f68f-4bb4-8cbf-f6dda3d4dadc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:35:27 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:35:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ee796-cf64-483c-ba27-af71b33e3c7d]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG os_brick.utils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating existing volume attachment record: e36b1d6d-01a0-4c97-989b-134c11a0653f {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:35:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:35:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:35:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:35:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:39 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:35:40 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:35:40 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=25.206787109375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance a7c09ee0-297b-49bb-b230-614b4d7e8349 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:35:40 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:35:41 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:35:41 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:35:41 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:35:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:35:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:35:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:35:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHJMbfIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:35:43 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:35:43 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:35:43 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c870fca2-9dbc-4527-aa24-02b4464096e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:35:43 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b372c-3173-4a8c-be5b-47df1fc8fe52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95] added
Oct 23 20:35:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc6b46-c16e-404b-be2a-282ff0780d9b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c99d26b-7cf2-40d9-b0c5-975b196b716c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHJMbfIW {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHJMbfIW" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f88fe00-47ef-4701-b1dd-57ade2bd4ff9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHJMbfIW'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f83163-f3c7-4a04-9d51-a2351e9ca572]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[293faf81-c3d4-485b-9736-85cc0d8fd3d5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:35:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:35:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bcfbdc-f8ce-4913-b5d9-f0a1b94231ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260]
Oct 23 20:35:43 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260] successful.
Oct 23 20:35:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e989a46-977e-4edf-9e57-8fbf7a5a581e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc852210-0412-4f00-9713-0221dcbd0755]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:35:43 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:35:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:35:43 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:35:43 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c02fb9-5446-46c8-9539-783d405e4ca5]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHJMbfIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid a7c09ee0-297b-49bb-b230-614b4d7e8349 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26237393736386630', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237393736386630', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'flavor' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:35:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:35:44 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:35:44 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:35:44 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:35:44 user nova-compute[74429]:   <serial>75040959-64aa-4b59-9af0-4b1f5c857d95</serial>
Oct 23 20:35:44 user nova-compute[74429]: </disk>
Oct 23 20:35:44 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] No VIF found with MAC fa:16:3e:7b:1b:39, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-c17d2e69-eac9-4347-b9ae-791e4545295a tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.263s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.184s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:35:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:35:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:35:46 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.compute.manager [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing instance network info cache due to event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating instance_info_cache with network_info: [{"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated VIF entry in instance network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:35:47 user nova-compute[74429]: DEBUG nova.network.neutron [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:35:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a50f01b2-9e64-412c-8ce5-7af3d586b772 req-7cf54f89-31fe-4476-a4c6-8af4546a4967 service nova] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:35:48 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing instance network info cache due to event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-changed-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG nova.compute.manager [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Refreshing instance network info cache due to event network-changed-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] Acquiring lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] Acquired lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:35:49 user nova-compute[74429]: DEBUG nova.network.neutron [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Refreshing network info cache for port fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:50 user nova-compute[74429]: INFO nova.compute.manager [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Rebooting instance
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated VIF entry in instance network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e88784a7-698b-4fc9-8378-e0cf41669625 req-cd8a092e-7a2d-46ad-92d0-9e656bfbf993 service nova] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updated VIF entry in instance network info cache for port fb357bee-a0e2-4cf4-99a1-2df4ae8bada9. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating instance_info_cache with network_info: [{"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9a94ac8e-1ae4-46d8-8f54-5e21225c39c8 req-f6136491-aed2-4343-add3-6580aa3fe2fe service nova] Releasing lock "refresh_cache-14889a96-fe7e-4a24-8957-f317d9ffe5c0" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.network.neutron [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:35:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:35:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-485f48d9-d3e3-4d14-a632-5c0bc3f6ec09 req-77f07a57-b18a-456b-9d6a-12d1882818ab service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-unplugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-485f48d9-d3e3-4d14-a632-5c0bc3f6ec09 req-77f07a57-b18a-456b-9d6a-12d1882818ab service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-485f48d9-d3e3-4d14-a632-5c0bc3f6ec09 req-77f07a57-b18a-456b-9d6a-12d1882818ab service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-485f48d9-d3e3-4d14-a632-5c0bc3f6ec09 req-77f07a57-b18a-456b-9d6a-12d1882818ab service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:53 user nova-compute[74429]: DEBUG nova.compute.manager [req-485f48d9-d3e3-4d14-a632-5c0bc3f6ec09 req-77f07a57-b18a-456b-9d6a-12d1882818ab service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-unplugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:35:53 user nova-compute[74429]: WARNING nova.compute.manager [req-485f48d9-d3e3-4d14-a632-5c0bc3f6ec09 req-77f07a57-b18a-456b-9d6a-12d1882818ab service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-unplugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state active and task_state reboot_started.
Oct 23 20:35:53 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance shutdown successfully.
Oct 23 20:35:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:54 user nova-compute[74429]: DEBUG nova.objects.instance [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:35:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:54 user nova-compute[74429]: INFO nova.compute.manager [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Attaching volume 4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 to /dev/vdb
Oct 23 20:35:55 user nova-compute[74429]: DEBUG os_brick.utils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4cca0b-b901-4b1b-bf70-fadd23c91162]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bcac56-7ed5-457f-8d67-c8445e453049]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d537a100-5676-4b57-b6b4-923c0e026010]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ddbab0-0803-4498-99af-ff774f385fbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:35:55 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad904716-33fe-49ca-83b8-d126514b9f60]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG os_brick.utils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating existing volume attachment record: b5e02deb-3cb1-434e-9996-942b81a9be79 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-acab17c8-11ad-4bb9-a13c-6453675d1902 req-9b88e398-0d0e-4aeb-aaa3-37b7bd80b19d service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-acab17c8-11ad-4bb9-a13c-6453675d1902 req-9b88e398-0d0e-4aeb-aaa3-37b7bd80b19d service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-acab17c8-11ad-4bb9-a13c-6453675d1902 req-9b88e398-0d0e-4aeb-aaa3-37b7bd80b19d service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-acab17c8-11ad-4bb9-a13c-6453675d1902 req-9b88e398-0d0e-4aeb-aaa3-37b7bd80b19d service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG nova.compute.manager [req-acab17c8-11ad-4bb9-a13c-6453675d1902 req-9b88e398-0d0e-4aeb-aaa3-37b7bd80b19d service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:35:55 user nova-compute[74429]: WARNING nova.compute.manager [req-acab17c8-11ad-4bb9-a13c-6453675d1902 req-9b88e398-0d0e-4aeb-aaa3-37b7bd80b19d service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state active and task_state reboot_started.
Oct 23 20:35:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:35:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance running successfully.
Oct 23 20:35:57 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance soft rebooted successfully.
Oct 23 20:35:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:35:57 user nova-compute[74429]: WARNING nova.compute.manager [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state active and task_state reboot_started.
Oct 23 20:35:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG nova.compute.manager [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:35:57 user nova-compute[74429]: WARNING nova.compute.manager [req-01d30675-8f41-4a87-86db-e110a4335b5d req-36004206-7593-41e0-9ee0-3bc291d930cb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state active and task_state reboot_started.
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eb881233-12a1-4897-9b93-34b0ebfc1ef6 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.323s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:35:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:35:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:36:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:36:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaqPTtuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:36:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:36:12 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:36:12 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[917b11c7-f116-4925-b0a1-2dff8c10e10d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:36:12 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cce706-8fc3-47f9-b18d-a75364bb2e98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08] added
Oct 23 20:36:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d8626-e912-435c-979d-3e31e6027466]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fe91d6-7798-43df-b498-698324720cc1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaqPTtuY {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaqPTtuY" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a02301-855c-4772-937a-15ad74310b7a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OaqPTtuY'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e691e97-c407-473b-ab77-453de93528a1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31e15a-7565-4fd9-9eab-fc68f803f87a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a6b1a8-2c87-4a43-87a0-715c892d5842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260]
Oct 23 20:36:12 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260] successful.
Oct 23 20:36:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f06f87-7001-4545-a596-65cdf4fb5561]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad54df9f-16cf-4e57-80db-18f2b629ccef]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)
Oct 23 20:36:12 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6b36ec-ffde-4eaa-bc6f-97a8f21dafcd]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:12 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaqPTtuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26632383561656262', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632383561656262', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG nova.objects.instance [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:36:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:36:13 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:36:13 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:36:13 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:36:13 user nova-compute[74429]:   <serial>4ed31c32-b93f-4f33-a5e6-0d4e997f3b08</serial>
Oct 23 20:36:13 user nova-compute[74429]: </disk>
Oct 23 20:36:13 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:d4:1a:a2, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-62d45d73-af5d-4a42-92e6-0270acf4731d tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.358s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:14 user nova-compute[74429]: INFO nova.compute.manager [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Detaching volume 4ed31c32-b93f-4f33-a5e6-0d4e997f3b08
Oct 23 20:36:14 user nova-compute[74429]: INFO nova.virt.block_device [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Attempting to driver detach volume 4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 from mountpoint /dev/vdb
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Attempting to detach device vdb from instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:36:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:36:14 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:36:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:36:14 user nova-compute[74429]:   <serial>4ed31c32-b93f-4f33-a5e6-0d4e997f3b08</serial>
Oct 23 20:36:14 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:36:14 user nova-compute[74429]: </disk>
Oct 23 20:36:14 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:36:14 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully detached device vdb from instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 from the persistent domain config.
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:36:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:36:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:36:14 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:36:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:36:14 user nova-compute[74429]:   <serial>4ed31c32-b93f-4f33-a5e6-0d4e997f3b08</serial>
Oct 23 20:36:14 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:36:14 user nova-compute[74429]: </disk>
Oct 23 20:36:14 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:36:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:36:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-changed-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Refreshing instance network info cache due to event network-changed-a4c24c57-cf5b-4378-9e8c-f169c4734a26. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] Acquiring lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] Acquired lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Refreshing network info cache for port a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updated VIF entry in instance network info cache for port a4c24c57-cf5b-4378-9e8c-f169c4734a26. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:36:30 user nova-compute[74429]: DEBUG nova.network.neutron [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updating instance_info_cache with network_info: [{"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-3e6a1bae-4dad-4be8-b70c-ec1296f604bc req-ff75257a-fdd7-49d4-a87b-fd821cfe04b7 service nova] Releasing lock "refresh_cache-a7c09ee0-297b-49bb-b230-614b4d7e8349" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:31 user nova-compute[74429]: INFO nova.compute.manager [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Terminating instance
Oct 23 20:36:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1652235-3e77-4f95-bbd5-514b153d3578 req-0a455699-f024-44c9-9260-77e60f430474 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-vif-unplugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1652235-3e77-4f95-bbd5-514b153d3578 req-0a455699-f024-44c9-9260-77e60f430474 service nova] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1652235-3e77-4f95-bbd5-514b153d3578 req-0a455699-f024-44c9-9260-77e60f430474 service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1652235-3e77-4f95-bbd5-514b153d3578 req-0a455699-f024-44c9-9260-77e60f430474 service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1652235-3e77-4f95-bbd5-514b153d3578 req-0a455699-f024-44c9-9260-77e60f430474 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] No waiting events found dispatching network-vif-unplugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1652235-3e77-4f95-bbd5-514b153d3578 req-0a455699-f024-44c9-9260-77e60f430474 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-vif-unplugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Instance destroyed successfully.
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.objects.instance [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'resources' on Instance uuid a7c09ee0-297b-49bb-b230-614b4d7e8349 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-552599111',display_name='tempest-TestVolumeBootPattern-server-552599111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-552599111',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:35:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-thodtgjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:35:01Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=a7c09ee0-297b-49bb-b230-614b4d7e8349,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "address": "fa:16:3e:16:25:61", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c24c57-cf", "ovs_interfaceid": "a4c24c57-cf5b-4378-9e8c-f169c4734a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_vif [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4c24c57-cf, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f69104f-faa9-40ac-a328-6d3cc3a3da03) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:36:32 user nova-compute[74429]: INFO os_vif [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:25:61,bridge_name='br-int',has_traffic_filtering=True,id=a4c24c57-cf5b-4378-9e8c-f169c4734a26,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c24c57-cf')
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:36:32 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb13dc0-e584-4671-9887-8905e1470b23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:36:32 user nova-compute[74429]: No targets found.
Oct 23 20:36:32 user nova-compute[74429]: iSNS:
Oct 23 20:36:32 user nova-compute[74429]: No targets found.
Oct 23 20:36:32 user nova-compute[74429]: STATIC:
Oct 23 20:36:32 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95
Oct 23 20:36:32 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:36:32 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:36:32 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08
Oct 23 20:36:32 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:36:32 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:36:32 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12
Oct 23 20:36:32 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:36:32 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:36:32 user nova-compute[74429]: FIRMWARE:
Oct 23 20:36:32 user nova-compute[74429]: No targets found.
Oct 23 20:36:32 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:36:32 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:36:32 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e37d13b-c956-4b9e-9007-949c9f12223b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96d7fb1-9130-4616-83fe-aafaa7aa2000]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:36:32 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:32 user nova-compute[74429]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)
Oct 23 20:36:32 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:36:32 user nova-compute[74429]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:32 user nova-compute[74429]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)
Oct 23 20:36:32 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50752830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370b04d-45ed-474b-8c0a-a20253c8ba55]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be7b74-89ad-4021-b98e-5dffc7a478fc]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de27f9f-3eaf-45f6-9b39-24b2220c22df]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ffb88-bbc2-44ac-8ab8-e716d9b0b678]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7d65ab22', '/dev/disk/by-id/scsi-23537643265313933', '/dev/disk/by-id/scsi-1SCST_BIO7d65ab22-57d2e19323778c75') {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[17978e08-da8b-47f5-84f0-13c1348d962f]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5529cf20-1c1b-49f8-8378-247c4484d1d0]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aaf736-9f26-4313-b705-4d5d2a7ff2b1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]
Oct 23 20:36:32 user nova-compute[74429]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.
Oct 23 20:36:32 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[551dd193-81f0-4379-a03f-10eb16d60342]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== disconnect_volume: return (298ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:36:32 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:36:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Deleting instance files /opt/stack/data/nova/instances/a7c09ee0-297b-49bb-b230-614b4d7e8349_del
Oct 23 20:36:32 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Deletion of /opt/stack/data/nova/instances/a7c09ee0-297b-49bb-b230-614b4d7e8349_del complete
Oct 23 20:36:33 user nova-compute[74429]: INFO nova.compute.manager [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 23 20:36:33 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:36:33 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:36:33 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:36:33 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:36:33 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Took 0.72 seconds to deallocate network for instance.
Oct 23 20:36:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] Acquiring lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] No waiting events found dispatching network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:36:34 user nova-compute[74429]: WARNING nova.compute.manager [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received unexpected event network-vif-plugged-a4c24c57-cf5b-4378-9e8c-f169c4734a26 for instance with vm_state active and task_state deleting.
Oct 23 20:36:34 user nova-compute[74429]: DEBUG nova.compute.manager [req-4822038e-5da1-42b4-9c6a-574b7b18821c req-d8729bbe-75ae-4d3c-9328-18b22b10cd47 service nova] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Received event network-vif-deleted-a4c24c57-cf5b-4378-9e8c-f169c4734a26 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:36:34 user nova-compute[74429]: INFO nova.compute.manager [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: a7c09ee0-297b-49bb-b230-614b4d7e8349] Took 0.92 seconds to detach 1 volumes for instance.
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:34 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Deleted allocations for instance a7c09ee0-297b-49bb-b230-614b4d7e8349
Oct 23 20:36:34 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-7a79f200-ccd7-493d-ada1-8092a4d120b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "a7c09ee0-297b-49bb-b230-614b4d7e8349" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.090s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:35 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 is timed out.
Oct 23 20:36:35 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully detached device vdb from instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 from the live domain config.
Oct 23 20:36:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaqPTtuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:36:35 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd7e67e-25ca-4227-8877-df02aeecfe28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:36:35 user nova-compute[74429]: No targets found.
Oct 23 20:36:35 user nova-compute[74429]: iSNS:
Oct 23 20:36:35 user nova-compute[74429]: No targets found.
Oct 23 20:36:35 user nova-compute[74429]: STATIC:
Oct 23 20:36:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95
Oct 23 20:36:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:36:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:36:35 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08
Oct 23 20:36:35 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:36:35 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:36:35 user nova-compute[74429]: FIRMWARE:
Oct 23 20:36:35 user nova-compute[74429]: No targets found.
Oct 23 20:36:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:36:35 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:36:35 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a181c3db-e55e-4d47-84fb-af489918aefc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[467479ff-c82e-4947-8536-bc583efc2476]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:35 user nova-compute[74429]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)
Oct 23 20:36:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:36:35 user nova-compute[74429]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 (non-flash)
Oct 23 20:36:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d580d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af145a-4a23-49f2-80fd-aee037d2958b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ecdcba-bcc9-4047-b945-11ffbfb3cc7c]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d6d57-660a-4225-b121-3e868b3fbfaa]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe83083-3b74-4af8-9ffc-a21b3b894390]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d13bc6-e051-4a65-ae60-c518c595d77a]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc54df-ace6-4185-8033-10d4cd45500c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260]
Oct 23 20:36:35 user nova-compute[74429]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08, portal: 172.16.0.220,3260] successful.
Oct 23 20:36:35 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ed31c32-b93f-4f33-a5e6-0d4e997f3b08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afdbd6b-d77d-421d-b550-9d49da13602b]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== disconnect_volume: return (286ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:36:35 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:36:36 user nova-compute[74429]: DEBUG nova.objects.instance [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:36:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edc57a80-1c19-460a-9af8-a6e844f8db41 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:39 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:40 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:36:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:36:41 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:36:41 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:36:41 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.20397186279297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:36:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:36:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:36:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:36:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:36:48 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:36:49 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:36:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:36:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:36:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:36:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:36:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:36:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:05 user nova-compute[74429]: INFO nova.compute.manager [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Terminating instance
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-73ddc37e-bc33-48ce-b17a-2e9e841c2a48 req-f1939986-89fd-4c03-b0c0-ea723d7e9612 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-vif-unplugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-73ddc37e-bc33-48ce-b17a-2e9e841c2a48 req-f1939986-89fd-4c03-b0c0-ea723d7e9612 service nova] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-73ddc37e-bc33-48ce-b17a-2e9e841c2a48 req-f1939986-89fd-4c03-b0c0-ea723d7e9612 service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-73ddc37e-bc33-48ce-b17a-2e9e841c2a48 req-f1939986-89fd-4c03-b0c0-ea723d7e9612 service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-73ddc37e-bc33-48ce-b17a-2e9e841c2a48 req-f1939986-89fd-4c03-b0c0-ea723d7e9612 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] No waiting events found dispatching network-vif-unplugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-73ddc37e-bc33-48ce-b17a-2e9e841c2a48 req-f1939986-89fd-4c03-b0c0-ea723d7e9612 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-vif-unplugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:37:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Instance destroyed successfully.
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.objects.instance [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'resources' on Instance uuid 14889a96-fe7e-4a24-8957-f317d9ffe5c0 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1084061467',display_name='tempest-AttachVolumeNegativeTest-server-1084061467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1084061467',id=45,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDorPdud4ZRbwnXrX7FxHaEKOv2+cj/qbJh7S5FEMzg9A09ckjHQFQWxBrgbjCcZT5qj2JgMhcgXuVGZuBdyU/bPFlJRXhiCCf7MZLln6LfE04iDkzTSBsK4OwBp7WIf1A==',key_name='tempest-keypair-1151786925',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-erj7z8zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=14889a96-fe7e-4a24-8957-f317d9ffe5c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "address": "fa:16:3e:d4:1a:a2", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb357bee-a0", "ovs_interfaceid": "fb357bee-a0e2-4cf4-99a1-2df4ae8bada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG os_vif [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb357bee-a0, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4ee7cfc-1f6f-4d91-9bb9-f46c87df1866) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:05 user nova-compute[74429]: INFO os_vif [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1a:a2,bridge_name='br-int',has_traffic_filtering=True,id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb357bee-a0')
Oct 23 20:37:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Deleting instance files /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0_del
Oct 23 20:37:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Deletion of /opt/stack/data/nova/instances/14889a96-fe7e-4a24-8957-f317d9ffe5c0_del complete
Oct 23 20:37:05 user nova-compute[74429]: INFO nova.compute.manager [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 23 20:37:05 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:37:05 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:37:06 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Took 0.71 seconds to deallocate network for instance.
Oct 23 20:37:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-13702418-eb5a-492e-99fb-94a44d9ad997 req-42ac2980-6bb9-4623-96fd-1f7d4568d870 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-vif-deleted-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:06 user nova-compute[74429]: INFO nova.compute.manager [req-13702418-eb5a-492e-99fb-94a44d9ad997 req-42ac2980-6bb9-4623-96fd-1f7d4568d870 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Neutron deleted interface fb357bee-a0e2-4cf4-99a1-2df4ae8bada9; detaching it from the instance and deleting it from the info cache
Oct 23 20:37:06 user nova-compute[74429]: DEBUG nova.network.neutron [req-13702418-eb5a-492e-99fb-94a44d9ad997 req-42ac2980-6bb9-4623-96fd-1f7d4568d870 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG nova.compute.manager [req-13702418-eb5a-492e-99fb-94a44d9ad997 req-42ac2980-6bb9-4623-96fd-1f7d4568d870 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Detach interface failed, port_id=fb357bee-a0e2-4cf4-99a1-2df4ae8bada9, reason: Instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0 could not be found. {{(pid=74429) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:37:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:06 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Deleted allocations for instance 14889a96-fe7e-4a24-8957-f317d9ffe5c0
Oct 23 20:37:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f785d95-8597-4d8c-919a-11c88cd44a9f tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-0ff7fd17-f0b0-47c1-bee7-89af701d687d req-d39e113c-cbfa-44ca-bf4b-6e3d18f3a0e4 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received event network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0ff7fd17-f0b0-47c1-bee7-89af701d687d req-d39e113c-cbfa-44ca-bf4b-6e3d18f3a0e4 service nova] Acquiring lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0ff7fd17-f0b0-47c1-bee7-89af701d687d req-d39e113c-cbfa-44ca-bf4b-6e3d18f3a0e4 service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-0ff7fd17-f0b0-47c1-bee7-89af701d687d req-d39e113c-cbfa-44ca-bf4b-6e3d18f3a0e4 service nova] Lock "14889a96-fe7e-4a24-8957-f317d9ffe5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:07 user nova-compute[74429]: DEBUG nova.compute.manager [req-0ff7fd17-f0b0-47c1-bee7-89af701d687d req-d39e113c-cbfa-44ca-bf4b-6e3d18f3a0e4 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] No waiting events found dispatching network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:37:07 user nova-compute[74429]: WARNING nova.compute.manager [req-0ff7fd17-f0b0-47c1-bee7-89af701d687d req-d39e113c-cbfa-44ca-bf4b-6e3d18f3a0e4 service nova] [instance: 14889a96-fe7e-4a24-8957-f317d9ffe5c0] Received unexpected event network-vif-plugged-fb357bee-a0e2-4cf4-99a1-2df4ae8bada9 for instance with vm_state deleted and task_state None.
Oct 23 20:37:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:37:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:37:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:37:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "9b628253-b572-46fb-958e-24e173bf8f9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:37:23 user nova-compute[74429]: INFO nova.compute.claims [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Claim successful on node user
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:37:23 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:37:23 user nova-compute[74429]: DEBUG nova.policy [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8399a03e24cd4cd7bbd8bdd9558d0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827ab59e22b4fa69f1475517e89727a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:37:23 user nova-compute[74429]: INFO nova.virt.block_device [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Booting with volume a17d4369-5785-443e-9fa4-cfde03d5fe12 at /dev/vda
Oct 23 20:37:24 user nova-compute[74429]: DEBUG os_brick.utils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18adb1a-dcd0-4c50-ac3e-52af72627006]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ace1b42-2a3e-42e4-b97a-8fdb9b5f8e97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ce94ea-8b56-4782-bbab-f381921f2b50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b363ad8f-9735-4ff0-a985-c98f55f78abc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:37:24 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:37:24 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25bb900-b855-4126-bf03-dc91b5756118]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG os_brick.utils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating existing volume attachment record: 5de3df0e-31b1-48c3-9012-3a4d0d7396b4 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:37:24 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Successfully created port: 9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Successfully updated port: 9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquired lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-changed-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Refreshing instance network info cache due to event network-changed-9aa182b9-ed5a-415e-8442-4f560b72e6da. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] Acquiring lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Releasing lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Instance network_info: |[{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] Acquired lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Refreshing network info cache for port 9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updated VIF entry in instance network info cache for port 9aa182b9-ed5a-415e-8442-4f560b72e6da. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:37:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-2dca2f67-cd78-4e42-9e9f-965e5de472e4 req-6ce9c4fa-395c-49ec-b19b-2d8987da6856 service nova] Releasing lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:37:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:37:40 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Creating image(s)
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/9b628253-b572-46fb-958e-24e173bf8f9c/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Start _get_guest_xml network_info=[{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '5de3df0e-31b1-48c3-9012-3a4d0d7396b4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b628253-b572-46fb-958e-24e173bf8f9c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a17d4369-5785-443e-9fa4-cfde03d5fe12', 'serial': 'a17d4369-5785-443e-9fa4-cfde03d5fe12'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:37:40 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:37:40 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:37:40 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:37:40 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:37:40 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:37:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[56570810-913d-4c4c-8448-4d95dd6c1910]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:37:40 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ef682-43a5-45f4-993c-8f5bc23dc452]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12] added
Oct 23 20:37:40 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a37d7-5831-4353-bd3e-0bc5a7ff6d38]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:40 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7143ca9-c21f-4424-96c4-9bbc1a6dc329]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqheJHxi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqheJHxi" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f3fd9-90aa-4505-b67a-1207c71fb6c4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FqheJHxi'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[40405e70-7788-4677-9bec-cc7f00018762]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db512ac-256c-4ee4-88c4-f7950c3f4530]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:37:41 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:37:41 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933e20c-2bec-46fa-8f82-da1db3603b80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]
Oct 23 20:37:41 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.
Oct 23 20:37:41 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165a55d-a82a-471a-b5a9-2a09867393f3]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[140c2355-f118-4cac-a576-6be4cd35697a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:37:41 user nova-compute[74429]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:37:41 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:37:41 user nova-compute[74429]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:37:41 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee47ddae-446f-448f-8895-868e75dd93e1]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG nova.compute.manager [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing instance network info cache due to event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:37:41 user nova-compute[74429]: DEBUG nova.network.neutron [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23537643265313933', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537643265313933', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-469761581',display_name='tempest-TestVolumeBootPattern-server-469761581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-469761581',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-oa7nhwtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:37:24Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=9b628253-b572-46fb-958e-24e173bf8f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.objects.instance [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b628253-b572-46fb-958e-24e173bf8f9c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:37:42 user nova-compute[74429]:   <uuid>9b628253-b572-46fb-958e-24e173bf8f9c</uuid>
Oct 23 20:37:42 user nova-compute[74429]:   <name>instance-0000002f</name>
Oct 23 20:37:42 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:37:42 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:37:42 user nova-compute[74429]:   <metadata>
Oct 23 20:37:42 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:37:42 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:37:42 user nova-compute[74429]:       <nova:name>tempest-TestVolumeBootPattern-server-469761581</nova:name>
Oct 23 20:37:42 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:37:40</nova:creationTime>
Oct 23 20:37:42 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:37:42 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:37:42 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:37:42 user nova-compute[74429]:       <nova:owner>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:user uuid="8399a03e24cd4cd7bbd8bdd9558d0798">tempest-TestVolumeBootPattern-2072234131-project-member</nova:user>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:project uuid="6827ab59e22b4fa69f1475517e89727a">tempest-TestVolumeBootPattern-2072234131</nova:project>
Oct 23 20:37:42 user nova-compute[74429]:       </nova:owner>
Oct 23 20:37:42 user nova-compute[74429]:       <nova:ports>
Oct 23 20:37:42 user nova-compute[74429]:         <nova:port uuid="9aa182b9-ed5a-415e-8442-4f560b72e6da">
Oct 23 20:37:42 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:37:42 user nova-compute[74429]:         </nova:port>
Oct 23 20:37:42 user nova-compute[74429]:       </nova:ports>
Oct 23 20:37:42 user nova-compute[74429]:     </nova:instance>
Oct 23 20:37:42 user nova-compute[74429]:   </metadata>
Oct 23 20:37:42 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:37:42 user nova-compute[74429]:     <system>
Oct 23 20:37:42 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:37:42 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:37:42 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:37:42 user nova-compute[74429]:       <entry name="serial">9b628253-b572-46fb-958e-24e173bf8f9c</entry>
Oct 23 20:37:42 user nova-compute[74429]:       <entry name="uuid">9b628253-b572-46fb-958e-24e173bf8f9c</entry>
Oct 23 20:37:42 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:37:42 user nova-compute[74429]:     </system>
Oct 23 20:37:42 user nova-compute[74429]:   </sysinfo>
Oct 23 20:37:42 user nova-compute[74429]:   <os>
Oct 23 20:37:42 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:37:42 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:37:42 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:37:42 user nova-compute[74429]:   </os>
Oct 23 20:37:42 user nova-compute[74429]:   <features>
Oct 23 20:37:42 user nova-compute[74429]:     <acpi/>
Oct 23 20:37:42 user nova-compute[74429]:     <apic/>
Oct 23 20:37:42 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:37:42 user nova-compute[74429]:   </features>
Oct 23 20:37:42 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:37:42 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:37:42 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:37:42 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:37:42 user nova-compute[74429]:   </clock>
Oct 23 20:37:42 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:37:42 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:37:42 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:37:42 user nova-compute[74429]:   </cpu>
Oct 23 20:37:42 user nova-compute[74429]:   <devices>
Oct 23 20:37:42 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:37:42 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:37:42 user nova-compute[74429]:       <source dev="/dev/sdb"/>
Oct 23 20:37:42 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:37:42 user nova-compute[74429]:       <serial>a17d4369-5785-443e-9fa4-cfde03d5fe12</serial>
Oct 23 20:37:42 user nova-compute[74429]:     </disk>
Oct 23 20:37:42 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:37:42 user nova-compute[74429]:       <mac address="fa:16:3e:f8:9f:97"/>
Oct 23 20:37:42 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:37:42 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:37:42 user nova-compute[74429]:       <target dev="tap9aa182b9-ed"/>
Oct 23 20:37:42 user nova-compute[74429]:     </interface>
Oct 23 20:37:42 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:37:42 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/9b628253-b572-46fb-958e-24e173bf8f9c/console.log" append="off"/>
Oct 23 20:37:42 user nova-compute[74429]:     </serial>
Oct 23 20:37:42 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:37:42 user nova-compute[74429]:     <video>
Oct 23 20:37:42 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:37:42 user nova-compute[74429]:     </video>
Oct 23 20:37:42 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:37:42 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:37:42 user nova-compute[74429]:     </rng>
Oct 23 20:37:42 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:37:42 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:37:42 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:37:42 user nova-compute[74429]:     </memballoon>
Oct 23 20:37:42 user nova-compute[74429]:   </devices>
Oct 23 20:37:42 user nova-compute[74429]: </domain>
Oct 23 20:37:42 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-469761581',display_name='tempest-TestVolumeBootPattern-server-469761581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-469761581',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-oa7nhwtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:37:24Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=9b628253-b572-46fb-958e-24e173bf8f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG os_vif [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77a4a2ff-44b7-5853-a8cb-18721b9d5cfe', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aa182b9-ed, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9aa182b9-ed, col_values=(('qos', UUID('65e3f945-73c4-4560-b8e5-a7adab36d9ad')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9aa182b9-ed, col_values=(('external_ids', {'iface-id': '9aa182b9-ed5a-415e-8442-4f560b72e6da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:9f:97', 'vm-uuid': '9b628253-b572-46fb-958e-24e173bf8f9c'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:42 user nova-compute[74429]: INFO os_vif [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed')
Oct 23 20:37:42 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:37:42 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.230754852294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.manager [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing instance network info cache due to event network-changed-cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] Acquiring lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No VIF found with MAC fa:16:3e:f8:9f:97, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.neutron [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated VIF entry in instance network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.neutron [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4f000699-bc92-43f6-a6d4-22bbf1dfd798 req-080d11f7-b5d1-4140-b124-ffcab553066a service nova] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] Acquired lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.network.neutron [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Refreshing network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9b628253-b572-46fb-958e-24e173bf8f9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:42 user nova-compute[74429]: INFO nova.compute.manager [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Detaching volume 75040959-64aa-4b59-9af0-4b1f5c857d95
Oct 23 20:37:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:37:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:43 user nova-compute[74429]: INFO nova.virt.block_device [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Attempting to driver detach volume 75040959-64aa-4b59-9af0-4b1f5c857d95 from mountpoint /dev/vdb
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Attempting to detach device vdb from instance d23ce6b0-370f-44b3-9d43-296be032b411 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:37:43 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:37:43 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:37:43 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:37:43 user nova-compute[74429]:   <serial>75040959-64aa-4b59-9af0-4b1f5c857d95</serial>
Oct 23 20:37:43 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:37:43 user nova-compute[74429]: </disk>
Oct 23 20:37:43 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:37:43 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully detached device vdb from instance d23ce6b0-370f-44b3-9d43-296be032b411 from the persistent domain config.
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d23ce6b0-370f-44b3-9d43-296be032b411 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:37:43 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:37:43 user nova-compute[74429]:   <source dev="/dev/sdc"/>
Oct 23 20:37:43 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:37:43 user nova-compute[74429]:   <serial>75040959-64aa-4b59-9af0-4b1f5c857d95</serial>
Oct 23 20:37:43 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:37:43 user nova-compute[74429]: </disk>
Oct 23 20:37:43 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.network.neutron [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updated VIF entry in instance network info cache for port cd809d0b-09e2-40a5-8e36-8bb8751efdc5. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.network.neutron [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [{"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:37:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-26d88a2c-71fe-4daa-8009-58fd218a3496 req-aeeb57e8-eb4c-4228-952b-5663d60343c9 service nova] Releasing lock "refresh_cache-d23ce6b0-370f-44b3-9d43-296be032b411" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:37:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-c7c0418d-e171-4e02-ba34-0c332ef7435a req-347e0ccf-ecef-45bd-8507-77a152954f05 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c7c0418d-e171-4e02-ba34-0c332ef7435a req-347e0ccf-ecef-45bd-8507-77a152954f05 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c7c0418d-e171-4e02-ba34-0c332ef7435a req-347e0ccf-ecef-45bd-8507-77a152954f05 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-c7c0418d-e171-4e02-ba34-0c332ef7435a req-347e0ccf-ecef-45bd-8507-77a152954f05 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG nova.compute.manager [req-c7c0418d-e171-4e02-ba34-0c332ef7435a req-347e0ccf-ecef-45bd-8507-77a152954f05 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:37:44 user nova-compute[74429]: WARNING nova.compute.manager [req-c7c0418d-e171-4e02-ba34-0c332ef7435a req-347e0ccf-ecef-45bd-8507-77a152954f05 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received unexpected event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with vm_state building and task_state spawning.
Oct 23 20:37:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:37:46 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Instance spawned successfully.
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:37:46 user nova-compute[74429]: INFO nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-24029147-db6f-4e10-91e4-14e81f0f8bcb req-25fff611-ccff-4bba-9f1a-598c805b48c9 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-24029147-db6f-4e10-91e4-14e81f0f8bcb req-25fff611-ccff-4bba-9f1a-598c805b48c9 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-24029147-db6f-4e10-91e4-14e81f0f8bcb req-25fff611-ccff-4bba-9f1a-598c805b48c9 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-24029147-db6f-4e10-91e4-14e81f0f8bcb req-25fff611-ccff-4bba-9f1a-598c805b48c9 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:46 user nova-compute[74429]: DEBUG nova.compute.manager [req-24029147-db6f-4e10-91e4-14e81f0f8bcb req-25fff611-ccff-4bba-9f1a-598c805b48c9 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:37:46 user nova-compute[74429]: WARNING nova.compute.manager [req-24029147-db6f-4e10-91e4-14e81f0f8bcb req-25fff611-ccff-4bba-9f1a-598c805b48c9 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received unexpected event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with vm_state building and task_state spawning.
Oct 23 20:37:46 user nova-compute[74429]: INFO nova.compute.manager [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Took 23.13 seconds to build instance.
Oct 23 20:37:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-8949c7b6-0637-4016-bae3-9d21aae15524 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "9b628253-b572-46fb-958e-24e173bf8f9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.220s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:37:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:37:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:50 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:50 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:37:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:37:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:37:59 user nova-compute[74429]: INFO nova.compute.claims [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Claim successful on node user
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:37:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.policy [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0276e322764c476dae32a7972c7851fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3ab94102b4496082c15d4ec466eb0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:37:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Creating image(s)
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "/opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:37:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk 1073741824" returned: 0 in 0.051s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Successfully created port: bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Cannot resize image /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Ensure instance console log exists: /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Successfully updated port: bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquired lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-changed-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Refreshing instance network info cache due to event network-changed-bf9b5a82-291f-40e7-8dda-99a2ceeb2745. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] Acquiring lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:38:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updating instance_info_cache with network_info: [{"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Releasing lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Instance network_info: |[{"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] Acquired lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Refreshing network info cache for port bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Start _get_guest_xml network_info=[{"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:38:01 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:38:01 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-726507090',display_name='tempest-AttachVolumeNegativeTest-server-726507090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-726507090',id=48,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjB5qyTxErfTh4JsRa/bHkYQ6ihjnmCY1d4J0MNkFjuAZUxFjDDPCuQ9ys7btZ4wX1ZAmmcziWa3AA/u/9S9D8ryZtUMedn0TJaE2dJNXopb9QnQtNxGquvc47JRWpM/A==',key_name='tempest-keypair-2081789072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-zm5410v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=c6400367-d1c8-4ed6-8d32-230ab50375c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'pci_devices' on Instance uuid c6400367-d1c8-4ed6-8d32-230ab50375c1 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:38:01 user nova-compute[74429]:   <uuid>c6400367-d1c8-4ed6-8d32-230ab50375c1</uuid>
Oct 23 20:38:01 user nova-compute[74429]:   <name>instance-00000030</name>
Oct 23 20:38:01 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:38:01 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:38:01 user nova-compute[74429]:   <metadata>
Oct 23 20:38:01 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:38:01 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:38:01 user nova-compute[74429]:       <nova:name>tempest-AttachVolumeNegativeTest-server-726507090</nova:name>
Oct 23 20:38:01 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:38:01</nova:creationTime>
Oct 23 20:38:01 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:38:01 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:38:01 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:38:01 user nova-compute[74429]:       <nova:owner>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:user uuid="0276e322764c476dae32a7972c7851fd">tempest-AttachVolumeNegativeTest-1373844485-project-member</nova:user>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:project uuid="5e3ab94102b4496082c15d4ec466eb0f">tempest-AttachVolumeNegativeTest-1373844485</nova:project>
Oct 23 20:38:01 user nova-compute[74429]:       </nova:owner>
Oct 23 20:38:01 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:38:01 user nova-compute[74429]:       <nova:ports>
Oct 23 20:38:01 user nova-compute[74429]:         <nova:port uuid="bf9b5a82-291f-40e7-8dda-99a2ceeb2745">
Oct 23 20:38:01 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 20:38:01 user nova-compute[74429]:         </nova:port>
Oct 23 20:38:01 user nova-compute[74429]:       </nova:ports>
Oct 23 20:38:01 user nova-compute[74429]:     </nova:instance>
Oct 23 20:38:01 user nova-compute[74429]:   </metadata>
Oct 23 20:38:01 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:38:01 user nova-compute[74429]:     <system>
Oct 23 20:38:01 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:38:01 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:38:01 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:38:01 user nova-compute[74429]:       <entry name="serial">c6400367-d1c8-4ed6-8d32-230ab50375c1</entry>
Oct 23 20:38:01 user nova-compute[74429]:       <entry name="uuid">c6400367-d1c8-4ed6-8d32-230ab50375c1</entry>
Oct 23 20:38:01 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:38:01 user nova-compute[74429]:     </system>
Oct 23 20:38:01 user nova-compute[74429]:   </sysinfo>
Oct 23 20:38:01 user nova-compute[74429]:   <os>
Oct 23 20:38:01 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:38:01 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:38:01 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:38:01 user nova-compute[74429]:   </os>
Oct 23 20:38:01 user nova-compute[74429]:   <features>
Oct 23 20:38:01 user nova-compute[74429]:     <acpi/>
Oct 23 20:38:01 user nova-compute[74429]:     <apic/>
Oct 23 20:38:01 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:38:01 user nova-compute[74429]:   </features>
Oct 23 20:38:01 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:38:01 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:38:01 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:38:01 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:38:01 user nova-compute[74429]:   </clock>
Oct 23 20:38:01 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:38:01 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:38:01 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:38:01 user nova-compute[74429]:   </cpu>
Oct 23 20:38:01 user nova-compute[74429]:   <devices>
Oct 23 20:38:01 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:38:01 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:38:01 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk"/>
Oct 23 20:38:01 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:38:01 user nova-compute[74429]:     </disk>
Oct 23 20:38:01 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:38:01 user nova-compute[74429]:       <mac address="fa:16:3e:9c:ac:f9"/>
Oct 23 20:38:01 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:38:01 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:38:01 user nova-compute[74429]:       <target dev="tapbf9b5a82-29"/>
Oct 23 20:38:01 user nova-compute[74429]:     </interface>
Oct 23 20:38:01 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:38:01 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/console.log" append="off"/>
Oct 23 20:38:01 user nova-compute[74429]:     </serial>
Oct 23 20:38:01 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:38:01 user nova-compute[74429]:     <video>
Oct 23 20:38:01 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:38:01 user nova-compute[74429]:     </video>
Oct 23 20:38:01 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:38:01 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:38:01 user nova-compute[74429]:     </rng>
Oct 23 20:38:01 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:38:01 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:38:01 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:38:01 user nova-compute[74429]:     </memballoon>
Oct 23 20:38:01 user nova-compute[74429]:   </devices>
Oct 23 20:38:01 user nova-compute[74429]: </domain>
Oct 23 20:38:01 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-726507090',display_name='tempest-AttachVolumeNegativeTest-server-726507090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-726507090',id=48,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjB5qyTxErfTh4JsRa/bHkYQ6ihjnmCY1d4J0MNkFjuAZUxFjDDPCuQ9ys7btZ4wX1ZAmmcziWa3AA/u/9S9D8ryZtUMedn0TJaE2dJNXopb9QnQtNxGquvc47JRWpM/A==',key_name='tempest-keypair-2081789072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-zm5410v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=c6400367-d1c8-4ed6-8d32-230ab50375c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG os_vif [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32a12ef3-3ee4-54f1-b443-926bfbb14ac1', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf9b5a82-29, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf9b5a82-29, col_values=(('qos', UUID('1d8eeb2c-dd47-4d50-88f4-72468908ea8c')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf9b5a82-29, col_values=(('external_ids', {'iface-id': 'bf9b5a82-291f-40e7-8dda-99a2ceeb2745', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:ac:f9', 'vm-uuid': 'c6400367-d1c8-4ed6-8d32-230ab50375c1'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:01 user nova-compute[74429]: INFO os_vif [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29')
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:9c:ac:f9, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updated VIF entry in instance network info cache for port bf9b5a82-291f-40e7-8dda-99a2ceeb2745. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updating instance_info_cache with network_info: [{"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:38:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d3f23a07-15ec-49c4-83a4-9d711432a3f5 req-00ea3b88-819e-4d32-9972-a62117dcd6a6 service nova] Releasing lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec95f973-01aa-4f26-9430-f4712d6595f9 req-07e9030b-d26b-42c4-a61d-eec164178f26 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec95f973-01aa-4f26-9430-f4712d6595f9 req-07e9030b-d26b-42c4-a61d-eec164178f26 service nova] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec95f973-01aa-4f26-9430-f4712d6595f9 req-07e9030b-d26b-42c4-a61d-eec164178f26 service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec95f973-01aa-4f26-9430-f4712d6595f9 req-07e9030b-d26b-42c4-a61d-eec164178f26 service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:02 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec95f973-01aa-4f26-9430-f4712d6595f9 req-07e9030b-d26b-42c4-a61d-eec164178f26 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] No waiting events found dispatching network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:38:02 user nova-compute[74429]: WARNING nova.compute.manager [req-ec95f973-01aa-4f26-9430-f4712d6595f9 req-07e9030b-d26b-42c4-a61d-eec164178f26 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received unexpected event network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 for instance with vm_state building and task_state spawning.
Oct 23 20:38:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:03 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d23ce6b0-370f-44b3-9d43-296be032b411 is timed out.
Oct 23 20:38:03 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully detached device vdb from instance d23ce6b0-370f-44b3-9d43-296be032b411 from the live domain config.
Oct 23 20:38:03 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHJMbfIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:38:03 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f0e8a-265f-45c4-a91b-19d089532cd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:38:03 user nova-compute[74429]: No targets found.
Oct 23 20:38:03 user nova-compute[74429]: iSNS:
Oct 23 20:38:03 user nova-compute[74429]: No targets found.
Oct 23 20:38:03 user nova-compute[74429]: STATIC:
Oct 23 20:38:03 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95
Oct 23 20:38:03 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:38:03 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:38:03 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12
Oct 23 20:38:03 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:38:03 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:38:03 user nova-compute[74429]: FIRMWARE:
Oct 23 20:38:03 user nova-compute[74429]: No targets found.
Oct 23 20:38:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:38:03 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:38:03 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1278cd-f067-4ac5-b8d9-63e23ee5ce38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe06dd3-9228-45c2-a175-73fb273d0464]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:38:03 user nova-compute[74429]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:38:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 (non-flash)
Oct 23 20:38:03 user nova-compute[74429]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:38:03 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d58164550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1643cf4-c13f-4f0f-b0a4-c890c83201dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fee0bb-fda7-4081-9603-bc4b9f00c4bd]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[10215beb-d09e-448f-ac47-dbbe4b0a6f52]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a5fbf4-12a6-415d-941d-4edf8be2333b]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770afa4-29c9-4e6a-9052-639927b27415]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:38:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[843fe023-9024-4371-91b6-51e957320257]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260]
Oct 23 20:38:04 user nova-compute[74429]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95, portal: 172.16.0.220,3260] successful.
Oct 23 20:38:04 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75040959-64aa-4b59-9af0-4b1f5c857d95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee5f3f5-e203-4a17-993d-e8a62b5fd8d6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] <== disconnect_volume: return (272ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:38:04 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Instance spawned successfully.
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'flavor' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-ddecf6e5-0a6a-45af-bd16-1b7237393a7e req-a7dd1fd7-fbd2-4aab-9c3a-8d8f81daf9c4 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ddecf6e5-0a6a-45af-bd16-1b7237393a7e req-a7dd1fd7-fbd2-4aab-9c3a-8d8f81daf9c4 service nova] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ddecf6e5-0a6a-45af-bd16-1b7237393a7e req-a7dd1fd7-fbd2-4aab-9c3a-8d8f81daf9c4 service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ddecf6e5-0a6a-45af-bd16-1b7237393a7e req-a7dd1fd7-fbd2-4aab-9c3a-8d8f81daf9c4 service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.compute.manager [req-ddecf6e5-0a6a-45af-bd16-1b7237393a7e req-a7dd1fd7-fbd2-4aab-9c3a-8d8f81daf9c4 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] No waiting events found dispatching network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:38:04 user nova-compute[74429]: WARNING nova.compute.manager [req-ddecf6e5-0a6a-45af-bd16-1b7237393a7e req-a7dd1fd7-fbd2-4aab-9c3a-8d8f81daf9c4 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received unexpected event network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 for instance with vm_state building and task_state spawning.
Oct 23 20:38:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a478f7a9-5b13-439b-a0b5-c08625ef98cc tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.970s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:04 user nova-compute[74429]: INFO nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Took 5.20 seconds to spawn the instance on the hypervisor.
Oct 23 20:38:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:38:05 user nova-compute[74429]: INFO nova.compute.manager [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Took 5.73 seconds to build instance.
Oct 23 20:38:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a347adfa-b8c7-4988-bcb5-05287e6cd259 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.872s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:42 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:42 user nova-compute[74429]: INFO nova.compute.manager [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Terminating instance
Oct 23 20:38:42 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c386b1f-9156-4021-a548-be238cf8cf69 req-5640b15c-66a2-48f0-8d56-f92ea6c1b5f7 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-unplugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c386b1f-9156-4021-a548-be238cf8cf69 req-5640b15c-66a2-48f0-8d56-f92ea6c1b5f7 service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c386b1f-9156-4021-a548-be238cf8cf69 req-5640b15c-66a2-48f0-8d56-f92ea6c1b5f7 service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-9c386b1f-9156-4021-a548-be238cf8cf69 req-5640b15c-66a2-48f0-8d56-f92ea6c1b5f7 service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c386b1f-9156-4021-a548-be238cf8cf69 req-5640b15c-66a2-48f0-8d56-f92ea6c1b5f7 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-unplugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG nova.compute.manager [req-9c386b1f-9156-4021-a548-be238cf8cf69 req-5640b15c-66a2-48f0-8d56-f92ea6c1b5f7 service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-unplugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:38:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=25.19219207763672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Instance destroyed successfully.
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.objects.instance [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lazy-loading 'resources' on Instance uuid d23ce6b0-370f-44b3-9d43-296be032b411 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1454507172',display_name='tempest-TestMinimumBasicScenario-server-1454507172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1454507172',id=44,image_ref='51fc440e-0c91-430d-8419-577aaf5e4fc8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXnNhpO8i7LOeo9mVcR4Mikq2bgheZ6A3NGJQQiE8Ipro8QVgRqhlUasi0vVZU0/2MH2nkd3laqGHemRAzs+0CVRTO35twQNz5RuVwzGGDEe0M56pr9T2WXVHofT+jI8g==',key_name='tempest-TestMinimumBasicScenario-317315725',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:33:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b1ae5a56f0d49dfb7f0aa63f8ef19ec',ramdisk_id='',reservation_id='r-w1cchh2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51fc440e-0c91-430d-8419-577aaf5e4fc8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1495059245',owner_user_name='tempest-TestMinimumBasicScenario-1495059245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:35:57Z,user_data=None,user_id='12045265f772493984fb3d041c8e9456',uuid=d23ce6b0-370f-44b3-9d43-296be032b411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converting VIF {"id": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "address": "fa:16:3e:7b:1b:39", "network": {"id": "ad792041-27d9-4136-8c10-dc6a284678a2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1561019147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b1ae5a56f0d49dfb7f0aa63f8ef19ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd809d0b-09", "ovs_interfaceid": "cd809d0b-09e2-40a5-8e36-8bb8751efdc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG os_vif [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd809d0b-09, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a70b5ed-c16d-4573-a389-86f719869a5f) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:38:44 user nova-compute[74429]: INFO os_vif [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:1b:39,bridge_name='br-int',has_traffic_filtering=True,id=cd809d0b-09e2-40a5-8e36-8bb8751efdc5,network=Network(ad792041-27d9-4136-8c10-dc6a284678a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd809d0b-09')
Oct 23 20:38:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Deleting instance files /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411_del
Oct 23 20:38:44 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Deletion of /opt/stack/data/nova/instances/d23ce6b0-370f-44b3-9d43-296be032b411_del complete
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance d23ce6b0-370f-44b3-9d43-296be032b411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9b628253-b572-46fb-958e-24e173bf8f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c6400367-d1c8-4ed6-8d32-230ab50375c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:38:44 user nova-compute[74429]: INFO nova.compute.manager [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:38:44 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Took 0.59 seconds to deallocate network for instance.
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:38:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:45 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Deleted allocations for instance d23ce6b0-370f-44b3-9d43-296be032b411
Oct 23 20:38:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3ab6eb6c-317a-4faf-b761-e70b59ec1391 tempest-TestMinimumBasicScenario-1495059245 tempest-TestMinimumBasicScenario-1495059245-project-member] Lock "d23ce6b0-370f-44b3-9d43-296be032b411" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] Acquiring lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] Lock "d23ce6b0-370f-44b3-9d43-296be032b411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] No waiting events found dispatching network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:38:45 user nova-compute[74429]: WARNING nova.compute.manager [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received unexpected event network-vif-plugged-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 for instance with vm_state deleted and task_state None.
Oct 23 20:38:45 user nova-compute[74429]: DEBUG nova.compute.manager [req-6709a30a-2399-4162-837f-d0ec4fa625ed req-6740760b-c481-4593-92d0-45a4b4829acb service nova] [instance: d23ce6b0-370f-44b3-9d43-296be032b411] Received event network-vif-deleted-cd809d0b-09e2-40a5-8e36-8bb8751efdc5 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:38:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:38:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:38:51 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 9b628253-b572-46fb-958e-24e173bf8f9c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:38:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:38:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:38:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:38:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:38:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:38:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:38:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:39:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:39:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:39:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-changed-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:39:15 user nova-compute[74429]: DEBUG nova.compute.manager [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Refreshing instance network info cache due to event network-changed-9aa182b9-ed5a-415e-8442-4f560b72e6da. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:39:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] Acquiring lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:39:15 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] Acquired lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:39:15 user nova-compute[74429]: DEBUG nova.network.neutron [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Refreshing network info cache for port 9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:39:16 user nova-compute[74429]: DEBUG nova.network.neutron [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updated VIF entry in instance network info cache for port 9aa182b9-ed5a-415e-8442-4f560b72e6da. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:39:16 user nova-compute[74429]: DEBUG nova.network.neutron [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:39:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a6db8378-6fb8-421b-a200-ef56b06013ec req-3c2da5d2-9f50-4834-9620-4404e3ddc9cf service nova] Releasing lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:39:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:39:31 user nova-compute[74429]: INFO nova.compute.claims [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Claim successful on node user
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:39:31 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:39:31 user nova-compute[74429]: DEBUG nova.policy [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8399a03e24cd4cd7bbd8bdd9558d0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827ab59e22b4fa69f1475517e89727a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:39:31 user nova-compute[74429]: INFO nova.virt.block_device [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Booting with volume 3001335b-1f49-4086-87ef-5c6496323a10 at /dev/vda
Oct 23 20:39:32 user nova-compute[74429]: DEBUG os_brick.utils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994af2d-d7d4-4072-94c5-d2c4c0794ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb03c7f-74f0-432c-a613-b6d5f73aae44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0612f2ce-fc82-47fa-8e87-bd4ae32fa3df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f5340e-245c-47fc-9eab-1a666de397a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:39:32 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:39:32 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f7491d-319d-4b84-b4a9-02345ce8b443]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG os_brick.utils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updating existing volume attachment record: e4c06fc6-d4e1-4c1a-931f-b97363268c57 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:39:32 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Successfully created port: a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Successfully updated port: a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquired lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-changed-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.compute.manager [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Refreshing instance network info cache due to event network-changed-a5c72910-bb04-49cd-9147-5f7380c65584. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] Acquiring lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updating instance_info_cache with network_info: [{"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Releasing lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Instance network_info: |[{"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] Acquired lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Refreshing network info cache for port a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updated VIF entry in instance network info cache for port a5c72910-bb04-49cd-9147-5f7380c65584. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG nova.network.neutron [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updating instance_info_cache with network_info: [{"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:39:33 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d448d423-ccd7-419a-905c-82cf43f2971c req-197c6ff5-01d6-485c-94fb-43d6ddbd5434 service nova] Releasing lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:39:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:39:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:39:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.258323669433594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9b628253-b572-46fb-958e-24e173bf8f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c6400367-d1c8-4ed6-8d32-230ab50375c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 0036ac34-6bd3-4a99-9c4f-c693cab302d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:39:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:39:49 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Creating image(s)
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Did not create local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Ensure instance console log exists: /opt/stack/data/nova/instances/0036ac34-6bd3-4a99-9c4f-c693cab302d2/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Start _get_guest_xml network_info=[{"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e4c06fc6-d4e1-4c1a-931f-b97363268c57', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnDYRFeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0036ac34-6bd3-4a99-9c4f-c693cab302d2', 'attached_at': '', 'detached_at': '', 'volume_id': '3001335b-1f49-4086-87ef-5c6496323a10', 'serial': '3001335b-1f49-4086-87ef-5c6496323a10'}, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:39:49 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:39:49 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnDYRFeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:39:49 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:39:49 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:39:49 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae0835-e54a-40ba-92e9-3bc11f5ef201]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:39:49 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4016b684-279c-439c-ba51-0ead945c4746]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10] added
Oct 23 20:39:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5d245-6226-4d06-8a33-2dbde772a537]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f776a8a-f69d-4f73-8e23-5b2a66bff4e2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnDYRFeA {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnDYRFeA" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e4a0e-f8cf-40a0-96c1-38d75e7b8e05]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lnDYRFeA'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4c83c0-41d2-44f4-a913-c07f6b50ce65]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd18d92-1c7f-4ba1-b4c8-c531d618c9e3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:39:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:39:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c751c389-52f5-4f14-a2b5-08893cf52aa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260]
Oct 23 20:39:49 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260] successful.
Oct 23 20:39:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a777b8ad-c4f4-496b-ba5d-9295e30241f9]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4243b4-55e2-48e0-95a5-7377e6498abf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:39:49 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:39:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:39:49 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:39:49 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9c0a80-696c-476c-838a-b9fe3ed1d375]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:49 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-changed-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Refreshing instance network info cache due to event network-changed-bf9b5a82-291f-40e7-8dda-99a2ceeb2745. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] Acquiring lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] Acquired lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Refreshing network info cache for port bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnDYRFeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23563653634316639', 'path': '/dev/sdc'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:39:50 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563653634316639', 'path': '/dev/sdc'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1344615325',display_name='tempest-TestVolumeBootPattern-server-1344615325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1344615325',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-8bv4fjhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:39:32Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=0036ac34-6bd3-4a99-9c4f-c693cab302d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.objects.instance [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'pci_devices' on Instance uuid 0036ac34-6bd3-4a99-9c4f-c693cab302d2 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.neutron [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updated VIF entry in instance network info cache for port bf9b5a82-291f-40e7-8dda-99a2ceeb2745. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.neutron [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updating instance_info_cache with network_info: [{"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:39:51 user nova-compute[74429]:   <uuid>0036ac34-6bd3-4a99-9c4f-c693cab302d2</uuid>
Oct 23 20:39:51 user nova-compute[74429]:   <name>instance-00000031</name>
Oct 23 20:39:51 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:39:51 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:39:51 user nova-compute[74429]:   <metadata>
Oct 23 20:39:51 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:39:51 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:39:51 user nova-compute[74429]:       <nova:name>tempest-TestVolumeBootPattern-server-1344615325</nova:name>
Oct 23 20:39:51 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:39:49</nova:creationTime>
Oct 23 20:39:51 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:39:51 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:39:51 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:39:51 user nova-compute[74429]:       <nova:owner>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:user uuid="8399a03e24cd4cd7bbd8bdd9558d0798">tempest-TestVolumeBootPattern-2072234131-project-member</nova:user>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:project uuid="6827ab59e22b4fa69f1475517e89727a">tempest-TestVolumeBootPattern-2072234131</nova:project>
Oct 23 20:39:51 user nova-compute[74429]:       </nova:owner>
Oct 23 20:39:51 user nova-compute[74429]:       <nova:ports>
Oct 23 20:39:51 user nova-compute[74429]:         <nova:port uuid="a5c72910-bb04-49cd-9147-5f7380c65584">
Oct 23 20:39:51 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 20:39:51 user nova-compute[74429]:         </nova:port>
Oct 23 20:39:51 user nova-compute[74429]:       </nova:ports>
Oct 23 20:39:51 user nova-compute[74429]:     </nova:instance>
Oct 23 20:39:51 user nova-compute[74429]:   </metadata>
Oct 23 20:39:51 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:39:51 user nova-compute[74429]:     <system>
Oct 23 20:39:51 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:39:51 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:39:51 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:39:51 user nova-compute[74429]:       <entry name="serial">0036ac34-6bd3-4a99-9c4f-c693cab302d2</entry>
Oct 23 20:39:51 user nova-compute[74429]:       <entry name="uuid">0036ac34-6bd3-4a99-9c4f-c693cab302d2</entry>
Oct 23 20:39:51 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:39:51 user nova-compute[74429]:     </system>
Oct 23 20:39:51 user nova-compute[74429]:   </sysinfo>
Oct 23 20:39:51 user nova-compute[74429]:   <os>
Oct 23 20:39:51 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:39:51 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:39:51 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:39:51 user nova-compute[74429]:   </os>
Oct 23 20:39:51 user nova-compute[74429]:   <features>
Oct 23 20:39:51 user nova-compute[74429]:     <acpi/>
Oct 23 20:39:51 user nova-compute[74429]:     <apic/>
Oct 23 20:39:51 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:39:51 user nova-compute[74429]:   </features>
Oct 23 20:39:51 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:39:51 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:39:51 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:39:51 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:39:51 user nova-compute[74429]:   </clock>
Oct 23 20:39:51 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:39:51 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:39:51 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:39:51 user nova-compute[74429]:   </cpu>
Oct 23 20:39:51 user nova-compute[74429]:   <devices>
Oct 23 20:39:51 user nova-compute[74429]:     <disk type="block" device="disk">
Oct 23 20:39:51 user nova-compute[74429]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:39:51 user nova-compute[74429]:       <source dev="/dev/sdc"/>
Oct 23 20:39:51 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:39:51 user nova-compute[74429]:       <serial>3001335b-1f49-4086-87ef-5c6496323a10</serial>
Oct 23 20:39:51 user nova-compute[74429]:     </disk>
Oct 23 20:39:51 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:39:51 user nova-compute[74429]:       <mac address="fa:16:3e:39:36:c9"/>
Oct 23 20:39:51 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:39:51 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:39:51 user nova-compute[74429]:       <target dev="tapa5c72910-bb"/>
Oct 23 20:39:51 user nova-compute[74429]:     </interface>
Oct 23 20:39:51 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:39:51 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/0036ac34-6bd3-4a99-9c4f-c693cab302d2/console.log" append="off"/>
Oct 23 20:39:51 user nova-compute[74429]:     </serial>
Oct 23 20:39:51 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:39:51 user nova-compute[74429]:     <video>
Oct 23 20:39:51 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:39:51 user nova-compute[74429]:     </video>
Oct 23 20:39:51 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:39:51 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:39:51 user nova-compute[74429]:     </rng>
Oct 23 20:39:51 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:39:51 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:39:51 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:39:51 user nova-compute[74429]:     </memballoon>
Oct 23 20:39:51 user nova-compute[74429]:   </devices>
Oct 23 20:39:51 user nova-compute[74429]: </domain>
Oct 23 20:39:51 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1344615325',display_name='tempest-TestVolumeBootPattern-server-1344615325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1344615325',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-8bv4fjhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:39:32Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=0036ac34-6bd3-4a99-9c4f-c693cab302d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG os_vif [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56d37a4d-a727-5e2f-a855-6cad46f95a60', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-25d9176a-f3f5-46be-b7fa-d76dab1c9764 req-34f9be3f-d8bb-44ff-8a04-e0b6e1f62272 service nova] Releasing lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5c72910-bb, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5c72910-bb, col_values=(('qos', UUID('1cb35791-d3a9-4eff-bc61-bd54dd19e56b')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5c72910-bb, col_values=(('external_ids', {'iface-id': 'a5c72910-bb04-49cd-9147-5f7380c65584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:36:c9', 'vm-uuid': '0036ac34-6bd3-4a99-9c4f-c693cab302d2'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:51 user nova-compute[74429]: INFO os_vif [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb')
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] No VIF found with MAC fa:16:3e:39:36:c9, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:39:51 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updating instance_info_cache with network_info: [{"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-c6400367-d1c8-4ed6-8d32-230ab50375c1" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7d7c89f-34b1-4584-8950-1f6d45b29708 req-bd28164b-397f-4b92-9f66-8ef56ce61e7b service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7d7c89f-34b1-4584-8950-1f6d45b29708 req-bd28164b-397f-4b92-9f66-8ef56ce61e7b service nova] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7d7c89f-34b1-4584-8950-1f6d45b29708 req-bd28164b-397f-4b92-9f66-8ef56ce61e7b service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a7d7c89f-34b1-4584-8950-1f6d45b29708 req-bd28164b-397f-4b92-9f66-8ef56ce61e7b service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG nova.compute.manager [req-a7d7c89f-34b1-4584-8950-1f6d45b29708 req-bd28164b-397f-4b92-9f66-8ef56ce61e7b service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] No waiting events found dispatching network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:39:52 user nova-compute[74429]: WARNING nova.compute.manager [req-a7d7c89f-34b1-4584-8950-1f6d45b29708 req-bd28164b-397f-4b92-9f66-8ef56ce61e7b service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received unexpected event network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 for instance with vm_state building and task_state spawning.
Oct 23 20:39:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:39:54 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Instance spawned successfully.
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-4c78d995-2012-4dd2-bfb0-44cf25cc55a5 req-bb31f472-3237-4585-8bdd-2abe6757bfa0 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c78d995-2012-4dd2-bfb0-44cf25cc55a5 req-bb31f472-3237-4585-8bdd-2abe6757bfa0 service nova] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c78d995-2012-4dd2-bfb0-44cf25cc55a5 req-bb31f472-3237-4585-8bdd-2abe6757bfa0 service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4c78d995-2012-4dd2-bfb0-44cf25cc55a5 req-bb31f472-3237-4585-8bdd-2abe6757bfa0 service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.compute.manager [req-4c78d995-2012-4dd2-bfb0-44cf25cc55a5 req-bb31f472-3237-4585-8bdd-2abe6757bfa0 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] No waiting events found dispatching network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:39:54 user nova-compute[74429]: WARNING nova.compute.manager [req-4c78d995-2012-4dd2-bfb0-44cf25cc55a5 req-bb31f472-3237-4585-8bdd-2abe6757bfa0 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received unexpected event network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 for instance with vm_state building and task_state spawning.
Oct 23 20:39:54 user nova-compute[74429]: INFO nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Took 5.05 seconds to spawn the instance on the hypervisor.
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:39:54 user nova-compute[74429]: INFO nova.compute.manager [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Took 23.25 seconds to build instance.
Oct 23 20:39:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9f07e415-e2c4-432d-9b40-c22b33a63b28 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.341s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid c6400367-d1c8-4ed6-8d32-230ab50375c1 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:39:57 user nova-compute[74429]: INFO nova.compute.manager [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Attaching volume e3d09b1d-223e-4a60-b5f1-400761a60196 to /dev/vdb
Oct 23 20:39:57 user nova-compute[74429]: DEBUG os_brick.utils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca48f8f-dd44-43f7-b46b-c8b0231bcb6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[08163366-df22-49f4-a71b-1d45930e5473]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[16561543-5818-461c-a587-8570bb2fc40d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c64572-7c46-4f36-a615-5be67e91f42d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:39:57 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:39:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5898ec-8520-460b-9a5b-9e0173b4ddf7]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG os_brick.utils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:39:57 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updating existing volume attachment record: 2b40598c-14c4-4e8d-a31a-3dc6d4004135 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:39:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:39:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:40:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUaWojuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:40:14 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:40:14 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:40:14 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[95714c2c-4a3f-4e9f-aa2d-991b7759b865]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:40:14 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fac43d-bb13-41c4-aad2-9df119eed7b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196] added
Oct 23 20:40:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d26c8-a6bd-4ebe-b26d-92be9c163f7c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166ab50-71b2-44e1-a57d-b1d5e874ecab]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUaWojuh {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUaWojuh" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1adff7-ae76-4c9e-8193-52da5d7a20a8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUaWojuh'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1adc03-8917-4659-ba26-b0a1149f5a57]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c88bdf9-07cc-4f7b-b4c1-cb5609ef733c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cecb7e2-ddf4-4c40-ab72-7bf3fa99d9ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260]
Oct 23 20:40:14 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260] successful.
Oct 23 20:40:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f107f9a6-bd6c-49a2-80fc-95fc9a737d2f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d004212-6c5e-487d-9f21-245f898106ba]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 (non-flash)
Oct 23 20:40:14 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb82d6-edf2-457e-839b-84e195600aa2]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:40:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUaWojuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:40:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:40:15 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23764313432643564', 'path': '/dev/sdd'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:40:15 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764313432643564', 'path': '/dev/sdd'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:40:15 user nova-compute[74429]: DEBUG nova.objects.instance [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid c6400367-d1c8-4ed6-8d32-230ab50375c1 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:40:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:40:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:40:16 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:40:16 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:40:16 user nova-compute[74429]:   <serial>e3d09b1d-223e-4a60-b5f1-400761a60196</serial>
Oct 23 20:40:16 user nova-compute[74429]: </disk>
Oct 23 20:40:16 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:40:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:40:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:40:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] No VIF found with MAC fa:16:3e:9c:ac:f9, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:40:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-a1255a0c-c39f-4ebf-90e4-94d3a7a6f6e4 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.851s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:40:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:40:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:40:17 user nova-compute[74429]: INFO nova.compute.manager [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Detaching volume e3d09b1d-223e-4a60-b5f1-400761a60196
Oct 23 20:40:17 user nova-compute[74429]: INFO nova.virt.block_device [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Attempting to driver detach volume e3d09b1d-223e-4a60-b5f1-400761a60196 from mountpoint /dev/vdb
Oct 23 20:40:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Attempting to detach device vdb from instance c6400367-d1c8-4ed6-8d32-230ab50375c1 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:40:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:40:17 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:40:17 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:40:17 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:40:17 user nova-compute[74429]:   <serial>e3d09b1d-223e-4a60-b5f1-400761a60196</serial>
Oct 23 20:40:17 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:40:17 user nova-compute[74429]: </disk>
Oct 23 20:40:17 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:40:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully detached device vdb from instance c6400367-d1c8-4ed6-8d32-230ab50375c1 from the persistent domain config.
Oct 23 20:40:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6400367-d1c8-4ed6-8d32-230ab50375c1 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:40:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:40:17 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:40:17 user nova-compute[74429]:   <source dev="/dev/sdd"/>
Oct 23 20:40:17 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:40:17 user nova-compute[74429]:   <serial>e3d09b1d-223e-4a60-b5f1-400761a60196</serial>
Oct 23 20:40:17 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:40:17 user nova-compute[74429]: </disk>
Oct 23 20:40:17 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:40:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6400367-d1c8-4ed6-8d32-230ab50375c1 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:40:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:40:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:40:37 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c6400367-d1c8-4ed6-8d32-230ab50375c1 is timed out.
Oct 23 20:40:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully detached device vdb from instance c6400367-d1c8-4ed6-8d32-230ab50375c1 from the live domain config.
Oct 23 20:40:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUaWojuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:40:37 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef7ce5b-b224-45e7-95b0-4d3e7ac068df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:40:37 user nova-compute[74429]: No targets found.
Oct 23 20:40:37 user nova-compute[74429]: iSNS:
Oct 23 20:40:37 user nova-compute[74429]: No targets found.
Oct 23 20:40:37 user nova-compute[74429]: STATIC:
Oct 23 20:40:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196
Oct 23 20:40:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:40:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:40:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10
Oct 23 20:40:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:40:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:40:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12
Oct 23 20:40:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:40:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:40:37 user nova-compute[74429]: FIRMWARE:
Oct 23 20:40:37 user nova-compute[74429]: No targets found.
Oct 23 20:40:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:40:37 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:40:37 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ea2b9-51b7-4bb0-9b85-66fb0184d1b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4f15f0-bdd1-43c1-adbf-d15a3b7e5999]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:40:37 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:40:37 user nova-compute[74429]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 (non-flash)
Oct 23 20:40:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:40:37 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:40:37 user nova-compute[74429]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 (non-flash)
Oct 23 20:40:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c5885e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196'): ({'sdd'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Removing single pathed devices sdd {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[360cfb31-f235-428f-8f79-6f18a79f271a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f7a90-23b4-4a15-9cf8-574b7994fc5f]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Flushing IO for device /dev/sdd {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a082ce4f-af66-41b6-b72f-4a2176b6ed5d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9615263-641d-4bde-a5c5-fdee1d58d578]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] SCSI volumes sdd have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:40:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17577c8-0eb2-41bc-935a-0b4ea3a92778]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[60afa7a9-df54-46ca-b646-8dd539293f1f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260]
Oct 23 20:40:38 user nova-compute[74429]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196, portal: 172.16.0.220,3260] successful.
Oct 23 20:40:38 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d09b1d-223e-4a60-b5f1-400761a60196 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3440fe5-109a-49c6-a9fa-9da90dc26c49]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] <== disconnect_volume: return (356ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:40:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:40:39 user nova-compute[74429]: DEBUG nova.objects.instance [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'flavor' on Instance uuid c6400367-d1c8-4ed6-8d32-230ab50375c1 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:40:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-84a38c1c-3e22-400a-861d-d4f2dc08ac45 tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.919s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:40:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:40:43 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:40:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:40:44 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.256450653076172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9b628253-b572-46fb-958e-24e173bf8f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance c6400367-d1c8-4ed6-8d32-230ab50375c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 0036ac34-6bd3-4a99-9c4f-c693cab302d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:40:44 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:40:45 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:40:45 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:40:45 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:40:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:40:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:40:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:48 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:40:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:40:53 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 9b628253-b572-46fb-958e-24e173bf8f9c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:40:54 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:40:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:40:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:40:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:40:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:40:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:41:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:41:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:07 user nova-compute[74429]: INFO nova.compute.manager [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Terminating instance
Oct 23 20:41:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-a26dcd68-4421-4c71-a77b-5332d368d42f req-cec58b5a-6ebd-4bf9-aa60-5b1b1be2e7bc service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-vif-unplugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a26dcd68-4421-4c71-a77b-5332d368d42f req-cec58b5a-6ebd-4bf9-aa60-5b1b1be2e7bc service nova] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a26dcd68-4421-4c71-a77b-5332d368d42f req-cec58b5a-6ebd-4bf9-aa60-5b1b1be2e7bc service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-a26dcd68-4421-4c71-a77b-5332d368d42f req-cec58b5a-6ebd-4bf9-aa60-5b1b1be2e7bc service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-a26dcd68-4421-4c71-a77b-5332d368d42f req-cec58b5a-6ebd-4bf9-aa60-5b1b1be2e7bc service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] No waiting events found dispatching network-vif-unplugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.compute.manager [req-a26dcd68-4421-4c71-a77b-5332d368d42f req-cec58b5a-6ebd-4bf9-aa60-5b1b1be2e7bc service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-vif-unplugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Instance destroyed successfully.
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.objects.instance [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lazy-loading 'resources' on Instance uuid c6400367-d1c8-4ed6-8d32-230ab50375c1 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-726507090',display_name='tempest-AttachVolumeNegativeTest-server-726507090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-726507090',id=48,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjB5qyTxErfTh4JsRa/bHkYQ6ihjnmCY1d4J0MNkFjuAZUxFjDDPCuQ9ys7btZ4wX1ZAmmcziWa3AA/u/9S9D8ryZtUMedn0TJaE2dJNXopb9QnQtNxGquvc47JRWpM/A==',key_name='tempest-keypair-2081789072',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:38:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e3ab94102b4496082c15d4ec466eb0f',ramdisk_id='',reservation_id='r-zm5410v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373844485',owner_user_name='tempest-AttachVolumeNegativeTest-1373844485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:38:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0276e322764c476dae32a7972c7851fd',uuid=c6400367-d1c8-4ed6-8d32-230ab50375c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converting VIF {"id": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "address": "fa:16:3e:9c:ac:f9", "network": {"id": "995f38a1-af43-4f37-9684-61de1be851b1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1943337911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e3ab94102b4496082c15d4ec466eb0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9b5a82-29", "ovs_interfaceid": "bf9b5a82-291f-40e7-8dda-99a2ceeb2745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG os_vif [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf9b5a82-29, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d8eeb2c-dd47-4d50-88f4-72468908ea8c) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:08 user nova-compute[74429]: INFO os_vif [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:ac:f9,bridge_name='br-int',has_traffic_filtering=True,id=bf9b5a82-291f-40e7-8dda-99a2ceeb2745,network=Network(995f38a1-af43-4f37-9684-61de1be851b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9b5a82-29')
Oct 23 20:41:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Deleting instance files /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1_del
Oct 23 20:41:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Deletion of /opt/stack/data/nova/instances/c6400367-d1c8-4ed6-8d32-230ab50375c1_del complete
Oct 23 20:41:08 user nova-compute[74429]: INFO nova.compute.manager [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 20:41:08 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:41:09 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:41:09 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Took 0.93 seconds to deallocate network for instance.
Oct 23 20:41:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-85b13f9d-45ea-4725-8898-6a5bbb7a9bcf req-cc861c00-0778-47ef-838b-266756c50fdf service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-vif-deleted-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:09 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:41:09 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:41:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:09 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Deleted allocations for instance c6400367-d1c8-4ed6-8d32-230ab50375c1
Oct 23 20:41:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-ddcf71ee-67c3-436b-8f88-954a564f50ec tempest-AttachVolumeNegativeTest-1373844485 tempest-AttachVolumeNegativeTest-1373844485-project-member] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-abb485df-4bdb-4d76-89ab-2d657561e1a4 req-87b23979-9568-4dee-bca7-a72194e7ac50 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received event network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-abb485df-4bdb-4d76-89ab-2d657561e1a4 req-87b23979-9568-4dee-bca7-a72194e7ac50 service nova] Acquiring lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-abb485df-4bdb-4d76-89ab-2d657561e1a4 req-87b23979-9568-4dee-bca7-a72194e7ac50 service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-abb485df-4bdb-4d76-89ab-2d657561e1a4 req-87b23979-9568-4dee-bca7-a72194e7ac50 service nova] Lock "c6400367-d1c8-4ed6-8d32-230ab50375c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:10 user nova-compute[74429]: DEBUG nova.compute.manager [req-abb485df-4bdb-4d76-89ab-2d657561e1a4 req-87b23979-9568-4dee-bca7-a72194e7ac50 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] No waiting events found dispatching network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:41:10 user nova-compute[74429]: WARNING nova.compute.manager [req-abb485df-4bdb-4d76-89ab-2d657561e1a4 req-87b23979-9568-4dee-bca7-a72194e7ac50 service nova] [instance: c6400367-d1c8-4ed6-8d32-230ab50375c1] Received unexpected event network-vif-plugged-bf9b5a82-291f-40e7-8dda-99a2ceeb2745 for instance with vm_state deleted and task_state None.
Oct 23 20:41:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:41:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:41:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:41:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:41:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:41:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:41:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-changed-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Refreshing instance network info cache due to event network-changed-a5c72910-bb04-49cd-9147-5f7380c65584. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:41:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] Acquiring lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:41:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] Acquired lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:41:22 user nova-compute[74429]: DEBUG nova.network.neutron [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Refreshing network info cache for port a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:41:23 user nova-compute[74429]: DEBUG nova.network.neutron [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updated VIF entry in instance network info cache for port a5c72910-bb04-49cd-9147-5f7380c65584. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:41:23 user nova-compute[74429]: DEBUG nova.network.neutron [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updating instance_info_cache with network_info: [{"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:41:23 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-87446091-3fe2-43c5-ab38-394f6d1b1314 req-72a8ced1-1320-4b01-8f5e-c3a4d9e8f5a8 service nova] Releasing lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:41:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-changed-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Refreshing instance network info cache due to event network-changed-a5c72910-bb04-49cd-9147-5f7380c65584. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] Acquiring lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] Acquired lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG nova.network.neutron [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Refreshing network info cache for port a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:24 user nova-compute[74429]: INFO nova.compute.manager [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Terminating instance
Oct 23 20:41:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updated VIF entry in instance network info cache for port a5c72910-bb04-49cd-9147-5f7380c65584. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.network.neutron [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updating instance_info_cache with network_info: [{"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d5fbb4cc-8a86-4a7b-9914-0c14b5875180 req-b0a6ab4f-3826-4773-8acc-e8810bf22d11 service nova] Releasing lock "refresh_cache-0036ac34-6bd3-4a99-9c4f-c693cab302d2" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-35b4acf0-696b-417d-aaea-d2fc629a04e0 req-5ca4798f-68e2-4194-92d6-cff73c2d8c8e service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-vif-unplugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-35b4acf0-696b-417d-aaea-d2fc629a04e0 req-5ca4798f-68e2-4194-92d6-cff73c2d8c8e service nova] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-35b4acf0-696b-417d-aaea-d2fc629a04e0 req-5ca4798f-68e2-4194-92d6-cff73c2d8c8e service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-35b4acf0-696b-417d-aaea-d2fc629a04e0 req-5ca4798f-68e2-4194-92d6-cff73c2d8c8e service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-35b4acf0-696b-417d-aaea-d2fc629a04e0 req-5ca4798f-68e2-4194-92d6-cff73c2d8c8e service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] No waiting events found dispatching network-vif-unplugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.compute.manager [req-35b4acf0-696b-417d-aaea-d2fc629a04e0 req-5ca4798f-68e2-4194-92d6-cff73c2d8c8e service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-vif-unplugged-a5c72910-bb04-49cd-9147-5f7380c65584 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:41:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Instance destroyed successfully.
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.objects.instance [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'resources' on Instance uuid 0036ac34-6bd3-4a99-9c4f-c693cab302d2 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1344615325',display_name='tempest-TestVolumeBootPattern-server-1344615325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1344615325',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-8bv4fjhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:39:55Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=0036ac34-6bd3-4a99-9c4f-c693cab302d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "a5c72910-bb04-49cd-9147-5f7380c65584", "address": "fa:16:3e:39:36:c9", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c72910-bb", "ovs_interfaceid": "a5c72910-bb04-49cd-9147-5f7380c65584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_vif [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5c72910-bb, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cb35791-d3a9-4eff-bc61-bd54dd19e56b) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:25 user nova-compute[74429]: INFO os_vif [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:36:c9,bridge_name='br-int',has_traffic_filtering=True,id=a5c72910-bb04-49cd-9147-5f7380c65584,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c72910-bb')
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnDYRFeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:41:25 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a247c42c-39ad-4687-a9bb-b1dea07fcb6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:41:25 user nova-compute[74429]: No targets found.
Oct 23 20:41:25 user nova-compute[74429]: iSNS:
Oct 23 20:41:25 user nova-compute[74429]: No targets found.
Oct 23 20:41:25 user nova-compute[74429]: STATIC:
Oct 23 20:41:25 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10
Oct 23 20:41:25 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:41:25 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:41:25 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12
Oct 23 20:41:25 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:41:25 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:41:25 user nova-compute[74429]: FIRMWARE:
Oct 23 20:41:25 user nova-compute[74429]: No targets found.
Oct 23 20:41:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:41:25 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:41:25 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677696a-4ea7-449b-a764-3cd9bb300c67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf47de71-7497-4c60-92d4-4fe56ce43d68]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:41:25 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:41:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:41:25 user nova-compute[74429]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 (non-flash)
Oct 23 20:41:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c5e2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10'): ({'sdc'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Removing single pathed devices sdc {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7155d-099e-4f69-8207-81037b799143]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e1b9fa-08dd-4606-9cdc-66d8be26dda5]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flushing IO for device /dev/sdc {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4cefb0-6349-4fd2-8d5a-e7df4cb5d1c2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b94a4f2-3eb3-4255-9063-df825811fbdd]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] SCSI volumes sdc have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ca6fcf89', '/dev/disk/by-id/scsi-1SCST_BIOca6fcf89-5ce641f9f87749eb', '/dev/disk/by-id/scsi-23563653634316639') {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aff654-b533-47f1-95a1-d18d0d132030]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4a4b31-caf8-4308-b6f6-80137c6baf48]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[531fa665-409c-491b-b368-960df16539c4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260]
Oct 23 20:41:25 user nova-compute[74429]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10, portal: 172.16.0.220,3260] successful.
Oct 23 20:41:25 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3001335b-1f49-4086-87ef-5c6496323a10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6581eaa-68de-4fd0-b409-d9ea1e89d71d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== disconnect_volume: return (299ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:41:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Deleting instance files /opt/stack/data/nova/instances/0036ac34-6bd3-4a99-9c4f-c693cab302d2_del
Oct 23 20:41:25 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Deletion of /opt/stack/data/nova/instances/0036ac34-6bd3-4a99-9c4f-c693cab302d2_del complete
Oct 23 20:41:25 user nova-compute[74429]: INFO nova.compute.manager [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 23 20:41:25 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:41:25 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:41:26 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:41:26 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Took 0.45 seconds to deallocate network for instance.
Oct 23 20:41:26 user nova-compute[74429]: DEBUG nova.compute.manager [req-7e47701d-0eee-4691-88ed-354a763f3965 req-c75597bb-871d-4491-a737-03ddd32f1d7c service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-vif-deleted-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-557bbea5-ad97-41a8-8dad-aca6ec14eb20 req-869bc78b-4249-489d-bea3-260a16c99e40 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received event network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-557bbea5-ad97-41a8-8dad-aca6ec14eb20 req-869bc78b-4249-489d-bea3-260a16c99e40 service nova] Acquiring lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-557bbea5-ad97-41a8-8dad-aca6ec14eb20 req-869bc78b-4249-489d-bea3-260a16c99e40 service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-557bbea5-ad97-41a8-8dad-aca6ec14eb20 req-869bc78b-4249-489d-bea3-260a16c99e40 service nova] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG nova.compute.manager [req-557bbea5-ad97-41a8-8dad-aca6ec14eb20 req-869bc78b-4249-489d-bea3-260a16c99e40 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] No waiting events found dispatching network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:41:27 user nova-compute[74429]: WARNING nova.compute.manager [req-557bbea5-ad97-41a8-8dad-aca6ec14eb20 req-869bc78b-4249-489d-bea3-260a16c99e40 service nova] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Received unexpected event network-vif-plugged-a5c72910-bb04-49cd-9147-5f7380c65584 for instance with vm_state active and task_state deleting.
Oct 23 20:41:27 user nova-compute[74429]: INFO nova.compute.manager [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 0036ac34-6bd3-4a99-9c4f-c693cab302d2] Took 0.95 seconds to detach 1 volumes for instance.
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:27 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Deleted allocations for instance 0036ac34-6bd3-4a99-9c4f-c693cab302d2
Oct 23 20:41:27 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06d9b61f-27a9-4c30-95c3-980a45cd6c02 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "0036ac34-6bd3-4a99-9c4f-c693cab302d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.855s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:41:45 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:41:46 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:41:46 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.283321380615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 9b628253-b572-46fb-958e-24e173bf8f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:41:46 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:41:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:50 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:41:54 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:41:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:41:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:41:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:42:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:42:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:42:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:42:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-changed-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Refreshing instance network info cache due to event network-changed-9aa182b9-ed5a-415e-8442-4f560b72e6da. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] Acquiring lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] Acquired lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Refreshing network info cache for port 9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "9b628253-b572-46fb-958e-24e173bf8f9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:36 user nova-compute[74429]: INFO nova.compute.manager [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Terminating instance
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.compute.manager [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec6e2355-9523-449a-9894-4f129725a404 req-23161d72-c295-4845-95f1-8ca5f8752457 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-unplugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec6e2355-9523-449a-9894-4f129725a404 req-23161d72-c295-4845-95f1-8ca5f8752457 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec6e2355-9523-449a-9894-4f129725a404 req-23161d72-c295-4845-95f1-8ca5f8752457 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-ec6e2355-9523-449a-9894-4f129725a404 req-23161d72-c295-4845-95f1-8ca5f8752457 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec6e2355-9523-449a-9894-4f129725a404 req-23161d72-c295-4845-95f1-8ca5f8752457 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-unplugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.compute.manager [req-ec6e2355-9523-449a-9894-4f129725a404 req-23161d72-c295-4845-95f1-8ca5f8752457 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-unplugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updated VIF entry in instance network info cache for port 9aa182b9-ed5a-415e-8442-4f560b72e6da. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG nova.network.neutron [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [{"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-94bcddd6-03cf-4e3b-b729-494c75069a7b req-c6b1f556-cc73-440f-b67c-287c5ba64211 service nova] Releasing lock "refresh_cache-9b628253-b572-46fb-958e-24e173bf8f9c" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:42:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Instance destroyed successfully.
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.objects.instance [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lazy-loading 'resources' on Instance uuid 9b628253-b572-46fb-958e-24e173bf8f9c {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-469761581',display_name='tempest-TestVolumeBootPattern-server-469761581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-469761581',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpoudAA8zm/+PYpdfFrc1UN/UohyF0JZ1vYi1kC+rGVNSCVYB24NizfyAmzOIae4okfZ+z2HcaGgIQZRROnorH8g5fphE/W8zmnz+is48kUmxQfBXNYeCSJAo1DnTTXg==',key_name='tempest-TestVolumeBootPattern-417810987',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6827ab59e22b4fa69f1475517e89727a',ramdisk_id='',reservation_id='r-oa7nhwtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2072234131',owner_user_name='tempest-TestVolumeBootPattern-2072234131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:37:47Z,user_data=None,user_id='8399a03e24cd4cd7bbd8bdd9558d0798',uuid=9b628253-b572-46fb-958e-24e173bf8f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converting VIF {"id": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "address": "fa:16:3e:f8:9f:97", "network": {"id": "b1083bde-0e74-407d-9467-51e444c60c0a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-165331498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6827ab59e22b4fa69f1475517e89727a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aa182b9-ed", "ovs_interfaceid": "9aa182b9-ed5a-415e-8442-4f560b72e6da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_vif [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aa182b9-ed, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65e3f945-73c4-4560-b8e5-a7adab36d9ad) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:37 user nova-compute[74429]: INFO os_vif [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:9f:97,bridge_name='br-int',has_traffic_filtering=True,id=9aa182b9-ed5a-415e-8442-4f560b72e6da,network=Network(b1083bde-0e74-407d-9467-51e444c60c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aa182b9-ed')
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqheJHxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:42:37 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68dc9bd-df4d-41ab-a9cc-6bc58b1c1474]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:42:37 user nova-compute[74429]: No targets found.
Oct 23 20:42:37 user nova-compute[74429]: iSNS:
Oct 23 20:42:37 user nova-compute[74429]: No targets found.
Oct 23 20:42:37 user nova-compute[74429]: STATIC:
Oct 23 20:42:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12
Oct 23 20:42:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:42:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:42:37 user nova-compute[74429]: FIRMWARE:
Oct 23 20:42:37 user nova-compute[74429]: No targets found.
Oct 23 20:42:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:42:37 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:42:37 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[563c3134-9e9c-4a1c-ace6-6eea3df081af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[621323ce-99cc-49f7-93a6-6ac197afba0f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:42:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 (non-flash)
Oct 23 20:42:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d505991b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a733c32-844d-44c7-81f3-f85e275e2d40]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[870baf30-2f07-49fc-b5f5-426316ea2586]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6bfc7-ab0c-4a5a-a7a1-deab9a9be438]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[3295b988-bd73-4be9-b292-d008edecb62e]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7d65ab22', '/dev/disk/by-id/scsi-23537643265313933', '/dev/disk/by-id/scsi-1SCST_BIO7d65ab22-57d2e19323778c75') {{(pid=85343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[092cbcc3-98d4-4e9c-8931-277611f9aeee]: (4, None) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee83b90-9f56-4b87-99dd-789e02bbbc3c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbde5713-defa-45ed-b22e-8970830ab727]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260]
Oct 23 20:42:37 user nova-compute[74429]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12, portal: 172.16.0.220,3260] successful.
Oct 23 20:42:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17d4369-5785-443e-9fa4-cfde03d5fe12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[808ad578-2701-45be-b308-d0f3300721c5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] <== disconnect_volume: return (388ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:42:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Deleting instance files /opt/stack/data/nova/instances/9b628253-b572-46fb-958e-24e173bf8f9c_del
Oct 23 20:42:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Deletion of /opt/stack/data/nova/instances/9b628253-b572-46fb-958e-24e173bf8f9c_del complete
Oct 23 20:42:37 user nova-compute[74429]: INFO nova.compute.manager [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 23 20:42:37 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:42:38 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Took 0.75 seconds to deallocate network for instance.
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-ab032488-d3d2-4a8b-b78b-09a485c661f0 req-be724dbb-0b19-4f1e-90bf-fb72253d5fef service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-deleted-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:42:38 user nova-compute[74429]: WARNING nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received unexpected event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with vm_state active and task_state deleting.
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:42:38 user nova-compute[74429]: WARNING nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received unexpected event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with vm_state active and task_state deleting.
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:42:38 user nova-compute[74429]: WARNING nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received unexpected event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with vm_state active and task_state deleting.
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-unplugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-unplugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-unplugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Acquiring lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] Lock "9b628253-b572-46fb-958e-24e173bf8f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:38 user nova-compute[74429]: DEBUG nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] No waiting events found dispatching network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:42:38 user nova-compute[74429]: WARNING nova.compute.manager [req-7a0a4424-d19a-468b-ac44-97a7e16a9bea req-325b1ecf-1e6e-4e77-902c-23447c9638c2 service nova] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Received unexpected event network-vif-plugged-9aa182b9-ed5a-415e-8442-4f560b72e6da for instance with vm_state active and task_state deleting.
Oct 23 20:42:39 user nova-compute[74429]: INFO nova.compute.manager [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] [instance: 9b628253-b572-46fb-958e-24e173bf8f9c] Took 0.85 seconds to detach 1 volumes for instance.
Oct 23 20:42:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:39 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:42:39 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:42:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:39 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Deleted allocations for instance 9b628253-b572-46fb-958e-24e173bf8f9c
Oct 23 20:42:39 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-127f8780-c9f2-474a-8681-f65acdb9c2b1 tempest-TestVolumeBootPattern-2072234131 tempest-TestVolumeBootPattern-2072234131-project-member] Lock "9b628253-b572-46fb-958e-24e173bf8f9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.193s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:46 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:47 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:42:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:42:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:42:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=25.281375885009766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:42:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:42:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:42:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:42:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:42:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:42:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:42:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:42:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:42:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:42:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:42:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:43:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:43:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:43:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:43:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:43:47 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:43:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:43:48 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:43:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=25.270328521728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:43:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:43:50 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:43:53 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:43:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:43:55 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:43:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:43:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:43:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:44:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:44:18 user nova-compute[74429]: INFO nova.compute.claims [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Claim successful on node user
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:44:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.policy [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e602f25acd8439b896eeda675def9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3b8ce3d5f40d3b1791dda4a477330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:44:18 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Creating image(s)
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "/opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "/opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:18 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.186s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk 1073741824" returned: 0 in 0.058s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Cannot resize image /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Ensure instance console log exists: /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:19 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Successfully created port: d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Successfully updated port: d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquired lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-changed-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.compute.manager [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Refreshing instance network info cache due to event network-changed-d15450da-9d1d-4ffe-9b8f-908a278b7792. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] Acquiring lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.neutron [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Releasing lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Instance network_info: |[{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] Acquired lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.neutron [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Refreshing network info cache for port d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Start _get_guest_xml network_info=[{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:44:20 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:44:20 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1418549233',display_name='tempest-VolumesSnapshotTestJSON-instance-1418549233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1418549233',id=50,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAhY3NZYwBYwxb5z5kjc7GPyZ+vcziYZE/PtjksSnnq05tgFNfxxmbbhUhypyrDGMIbInpGj8MkmJNjSNXYfR7mcE0NKxDuBKBBJlPCe7Vsasn2QmBUzn3zIzSqif5W8A==',key_name='tempest-keypair-2034778977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97f3b8ce3d5f40d3b1791dda4a477330',ramdisk_id='',reservation_id='r-u38770sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1478717835',owner_user_name='tempest-VolumesSnapshotTestJSON-1478717835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e602f25acd8439b896eeda675def9de',uuid=6f8fb335-f338-44fe-9050-40a759e77755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converting VIF {"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.objects.instance [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:44:20 user nova-compute[74429]:   <uuid>6f8fb335-f338-44fe-9050-40a759e77755</uuid>
Oct 23 20:44:20 user nova-compute[74429]:   <name>instance-00000032</name>
Oct 23 20:44:20 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:44:20 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:44:20 user nova-compute[74429]:   <metadata>
Oct 23 20:44:20 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:44:20 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:44:20 user nova-compute[74429]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1418549233</nova:name>
Oct 23 20:44:20 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:44:20</nova:creationTime>
Oct 23 20:44:20 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:44:20 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:44:20 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:44:20 user nova-compute[74429]:       <nova:owner>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:user uuid="1e602f25acd8439b896eeda675def9de">tempest-VolumesSnapshotTestJSON-1478717835-project-member</nova:user>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:project uuid="97f3b8ce3d5f40d3b1791dda4a477330">tempest-VolumesSnapshotTestJSON-1478717835</nova:project>
Oct 23 20:44:20 user nova-compute[74429]:       </nova:owner>
Oct 23 20:44:20 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:44:20 user nova-compute[74429]:       <nova:ports>
Oct 23 20:44:20 user nova-compute[74429]:         <nova:port uuid="d15450da-9d1d-4ffe-9b8f-908a278b7792">
Oct 23 20:44:20 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 20:44:20 user nova-compute[74429]:         </nova:port>
Oct 23 20:44:20 user nova-compute[74429]:       </nova:ports>
Oct 23 20:44:20 user nova-compute[74429]:     </nova:instance>
Oct 23 20:44:20 user nova-compute[74429]:   </metadata>
Oct 23 20:44:20 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:44:20 user nova-compute[74429]:     <system>
Oct 23 20:44:20 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:44:20 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:44:20 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:44:20 user nova-compute[74429]:       <entry name="serial">6f8fb335-f338-44fe-9050-40a759e77755</entry>
Oct 23 20:44:20 user nova-compute[74429]:       <entry name="uuid">6f8fb335-f338-44fe-9050-40a759e77755</entry>
Oct 23 20:44:20 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:44:20 user nova-compute[74429]:     </system>
Oct 23 20:44:20 user nova-compute[74429]:   </sysinfo>
Oct 23 20:44:20 user nova-compute[74429]:   <os>
Oct 23 20:44:20 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:44:20 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:44:20 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:44:20 user nova-compute[74429]:   </os>
Oct 23 20:44:20 user nova-compute[74429]:   <features>
Oct 23 20:44:20 user nova-compute[74429]:     <acpi/>
Oct 23 20:44:20 user nova-compute[74429]:     <apic/>
Oct 23 20:44:20 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:44:20 user nova-compute[74429]:   </features>
Oct 23 20:44:20 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:44:20 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:44:20 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:44:20 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:44:20 user nova-compute[74429]:   </clock>
Oct 23 20:44:20 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:44:20 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:44:20 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:44:20 user nova-compute[74429]:   </cpu>
Oct 23 20:44:20 user nova-compute[74429]:   <devices>
Oct 23 20:44:20 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:44:20 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:44:20 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk"/>
Oct 23 20:44:20 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:44:20 user nova-compute[74429]:     </disk>
Oct 23 20:44:20 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:44:20 user nova-compute[74429]:       <mac address="fa:16:3e:5a:f4:01"/>
Oct 23 20:44:20 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:44:20 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:44:20 user nova-compute[74429]:       <target dev="tapd15450da-9d"/>
Oct 23 20:44:20 user nova-compute[74429]:     </interface>
Oct 23 20:44:20 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:44:20 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/console.log" append="off"/>
Oct 23 20:44:20 user nova-compute[74429]:     </serial>
Oct 23 20:44:20 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:44:20 user nova-compute[74429]:     <video>
Oct 23 20:44:20 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:44:20 user nova-compute[74429]:     </video>
Oct 23 20:44:20 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:44:20 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:44:20 user nova-compute[74429]:     </rng>
Oct 23 20:44:20 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:44:20 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:44:20 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:44:20 user nova-compute[74429]:     </memballoon>
Oct 23 20:44:20 user nova-compute[74429]:   </devices>
Oct 23 20:44:20 user nova-compute[74429]: </domain>
Oct 23 20:44:20 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1418549233',display_name='tempest-VolumesSnapshotTestJSON-instance-1418549233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1418549233',id=50,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAhY3NZYwBYwxb5z5kjc7GPyZ+vcziYZE/PtjksSnnq05tgFNfxxmbbhUhypyrDGMIbInpGj8MkmJNjSNXYfR7mcE0NKxDuBKBBJlPCe7Vsasn2QmBUzn3zIzSqif5W8A==',key_name='tempest-keypair-2034778977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97f3b8ce3d5f40d3b1791dda4a477330',ramdisk_id='',reservation_id='r-u38770sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1478717835',owner_user_name='tempest-VolumesSnapshotTestJSON-1478717835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e602f25acd8439b896eeda675def9de',uuid=6f8fb335-f338-44fe-9050-40a759e77755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converting VIF {"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG os_vif [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85cdce4a-b5ff-597a-af59-4c0b4c5cbe0f', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd15450da-9d, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd15450da-9d, col_values=(('qos', UUID('603251c3-8fe7-42e3-bcc0-7b45e24be6df')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd15450da-9d, col_values=(('external_ids', {'iface-id': 'd15450da-9d1d-4ffe-9b8f-908a278b7792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:f4:01', 'vm-uuid': '6f8fb335-f338-44fe-9050-40a759e77755'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:20 user nova-compute[74429]: INFO os_vif [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d')
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:44:20 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No VIF found with MAC fa:16:3e:5a:f4:01, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:44:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updated VIF entry in instance network info cache for port d15450da-9d1d-4ffe-9b8f-908a278b7792. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:44:21 user nova-compute[74429]: DEBUG nova.network.neutron [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:44:21 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-d8071278-fefb-486e-8dc5-0e5dc0fff0eb req-1684ab5b-5c59-4913-ae25-ef45c79f69e7 service nova] Releasing lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-42ef0e5a-b4fc-465e-aec3-79423a308661 req-fcd3a5ae-9093-4d4a-9642-136684e0581d service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-42ef0e5a-b4fc-465e-aec3-79423a308661 req-fcd3a5ae-9093-4d4a-9642-136684e0581d service nova] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-42ef0e5a-b4fc-465e-aec3-79423a308661 req-fcd3a5ae-9093-4d4a-9642-136684e0581d service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-42ef0e5a-b4fc-465e-aec3-79423a308661 req-fcd3a5ae-9093-4d4a-9642-136684e0581d service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG nova.compute.manager [req-42ef0e5a-b4fc-465e-aec3-79423a308661 req-fcd3a5ae-9093-4d4a-9642-136684e0581d service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] No waiting events found dispatching network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:44:22 user nova-compute[74429]: WARNING nova.compute.manager [req-42ef0e5a-b4fc-465e-aec3-79423a308661 req-fcd3a5ae-9093-4d4a-9642-136684e0581d service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received unexpected event network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 for instance with vm_state building and task_state spawning.
Oct 23 20:44:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:44:24 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Instance spawned successfully.
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:44:24 user nova-compute[74429]: INFO nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Took 5.84 seconds to spawn the instance on the hypervisor.
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-037968af-1cf9-4215-8d1d-5670989e12ed req-64e55d88-f85f-461b-81e6-7afd0920d9e5 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-037968af-1cf9-4215-8d1d-5670989e12ed req-64e55d88-f85f-461b-81e6-7afd0920d9e5 service nova] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-037968af-1cf9-4215-8d1d-5670989e12ed req-64e55d88-f85f-461b-81e6-7afd0920d9e5 service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-037968af-1cf9-4215-8d1d-5670989e12ed req-64e55d88-f85f-461b-81e6-7afd0920d9e5 service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:24 user nova-compute[74429]: DEBUG nova.compute.manager [req-037968af-1cf9-4215-8d1d-5670989e12ed req-64e55d88-f85f-461b-81e6-7afd0920d9e5 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] No waiting events found dispatching network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:44:24 user nova-compute[74429]: WARNING nova.compute.manager [req-037968af-1cf9-4215-8d1d-5670989e12ed req-64e55d88-f85f-461b-81e6-7afd0920d9e5 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received unexpected event network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 for instance with vm_state building and task_state spawning.
Oct 23 20:44:24 user nova-compute[74429]: INFO nova.compute.manager [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Took 6.38 seconds to build instance.
Oct 23 20:44:24 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-3437b494-0b2d-4dce-b46d-b74447a6c1b3 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.475s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:44:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:47 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:48 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:48 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:48 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:44:48 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:49 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:44:49 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=25.239524841308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6f8fb335-f338-44fe-9050-40a759e77755 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:44:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:44:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:44:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:44:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:44:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:44:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:44:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:45:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:45:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:45:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:45:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:45:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:45:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:45:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:45:49 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:45:50 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:45:50 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.23871612548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6f8fb335-f338-44fe-9050-40a759e77755 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:45:50 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:45:51 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:45:51 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:45:51 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:45:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:45:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:45:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:45:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:45:58 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:45:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:45:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:46:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:01 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:46:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:46:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:46:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "6f8fb335-f338-44fe-9050-40a759e77755" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:46:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "6f8fb335-f338-44fe-9050-40a759e77755" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:46:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-changed-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:46:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Refreshing instance network info cache due to event network-changed-d15450da-9d1d-4ffe-9b8f-908a278b7792. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:46:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] Acquiring lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:46:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] Acquired lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:46:09 user nova-compute[74429]: DEBUG nova.network.neutron [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Refreshing network info cache for port d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:46:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updated VIF entry in instance network info cache for port d15450da-9d1d-4ffe-9b8f-908a278b7792. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:46:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:46:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7218f984-c89c-42df-92ba-5202d10fce71 req-76b2c682-fd2f-4645-99c9-921cbcaebeae service nova] Releasing lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:46:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:46:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:46:10 user nova-compute[74429]: DEBUG nova.objects.instance [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'flavor' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:46:10 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Ignoring supplied device name: /dev/vdb
Oct 23 20:46:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.256s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:46:11 user nova-compute[74429]: INFO nova.compute.manager [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Attaching volume 87e98c5a-acee-4df9-8370-8cded53a4ecd to /dev/vdb
Oct 23 20:46:11 user nova-compute[74429]: DEBUG os_brick.utils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3eb99b-67ec-421e-b6f8-d16db6b818e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a7558d-9466-420a-b98b-4f3defc56abf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a75121-f22a-4cb7-a21d-22e7e85a45d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[468be760-b0ce-46bf-98b6-753af1c24a8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:46:11 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:46:11 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf74775-712e-40bb-923a-5e76d25f87d6]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG os_brick.utils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:46:11 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating existing volume attachment record: 64435ccc-f1f8-45ec-861b-39b61f8094f6 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:46:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:17 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:46:17 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:46:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:19 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:19 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:46:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:46:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:46:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:46:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roEGdUOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:46:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:46:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:46:36 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813db16-ff59-4e0b-b851-2dd1328ff7bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:46:36 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1ce3c-1bac-4a95-907c-20be3b9aaea2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd] added
Oct 23 20:46:36 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf528f-f3d5-4cd7-9e60-6b1ca24b00b2]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc70fe71-a90d-4ed0-a5de-8fe5c148dc09]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roEGdUOZ {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roEGdUOZ" returned: 0 in 0.031s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceadaeb3-4f08-4733-a9a6-28ab39c32a32]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roEGdUOZ'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d258d-db2e-48d4-905c-4f8d07f4fd49]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f4004a-de5f-4795-bbc6-ecb4b9931a90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:46:36 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:46:36 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:46:36 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:46:36 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:46:36 user nova-compute[74429]: 
Oct 23 20:46:36 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[672e91d2-ff07-4ed2-ab66-55779c303fbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260]
Oct 23 20:46:37 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260] successful.
Oct 23 20:46:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcdd83c-cbea-42fa-af5e-3b5ed285d85c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f21be-06bd-405d-8781-57ae1dd1a8f6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd (non-flash)
Oct 23 20:46:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd (non-flash)
Oct 23 20:46:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[199931dc-9496-47cb-836b-a493b05d4283]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:46:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roEGdUOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23137613633386363', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137613633386363', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'flavor' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:46:38 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:46:38 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:46:38 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:46:38 user nova-compute[74429]:   <serial>87e98c5a-acee-4df9-8370-8cded53a4ecd</serial>
Oct 23 20:46:38 user nova-compute[74429]: </disk>
Oct 23 20:46:38 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No VIF found with MAC fa:16:3e:5a:f4:01, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:46:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-edf4e01c-a37e-4667-80b7-d25a8c959a36 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.393s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:46:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:46:49 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:46:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:46:51 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:46:51 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:46:51 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:46:52 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:46:52 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.237674713134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6f8fb335-f338-44fe-9050-40a759e77755 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:46:52 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:46:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:55 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:46:57 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:46:58 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [{"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:46:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-6f8fb335-f338-44fe-9050-40a759e77755" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:46:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:46:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:47:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:47:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:47:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:47:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:47:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:47:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:47:36 user nova-compute[74429]: INFO nova.compute.manager [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Detaching volume 87e98c5a-acee-4df9-8370-8cded53a4ecd
Oct 23 20:47:36 user nova-compute[74429]: INFO nova.virt.block_device [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Attempting to driver detach volume 87e98c5a-acee-4df9-8370-8cded53a4ecd from mountpoint /dev/vdb
Oct 23 20:47:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Attempting to detach device vdb from instance 6f8fb335-f338-44fe-9050-40a759e77755 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:47:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:47:36 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:47:36 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:47:36 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:47:36 user nova-compute[74429]:   <serial>87e98c5a-acee-4df9-8370-8cded53a4ecd</serial>
Oct 23 20:47:36 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:47:36 user nova-compute[74429]: </disk>
Oct 23 20:47:36 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:47:36 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:47:36 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully detached device vdb from instance 6f8fb335-f338-44fe-9050-40a759e77755 from the persistent domain config.
Oct 23 20:47:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f8fb335-f338-44fe-9050-40a759e77755 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:47:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:47:36 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:47:36 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:47:36 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:47:36 user nova-compute[74429]:   <serial>87e98c5a-acee-4df9-8370-8cded53a4ecd</serial>
Oct 23 20:47:36 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:47:36 user nova-compute[74429]: </disk>
Oct 23 20:47:36 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:47:36 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:47:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:47:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:53 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:47:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:47:53 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:47:53 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:47:53 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:54 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:47:54 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.236713409423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance 6f8fb335-f338-44fe-9050-40a759e77755 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:47:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:47:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:47:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:56 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f8fb335-f338-44fe-9050-40a759e77755 is timed out.
Oct 23 20:47:56 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully detached device vdb from instance 6f8fb335-f338-44fe-9050-40a759e77755 from the live domain config.
Oct 23 20:47:56 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:47:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roEGdUOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:47:56 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:47:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:47:56 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:47:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ffb408-93eb-48f7-8f6d-b0d2f47648a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:47:57 user nova-compute[74429]: No targets found.
Oct 23 20:47:57 user nova-compute[74429]: iSNS:
Oct 23 20:47:57 user nova-compute[74429]: No targets found.
Oct 23 20:47:57 user nova-compute[74429]: STATIC:
Oct 23 20:47:57 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd
Oct 23 20:47:57 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:47:57 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:47:57 user nova-compute[74429]: FIRMWARE:
Oct 23 20:47:57 user nova-compute[74429]: No targets found.
Oct 23 20:47:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:47:57 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:47:57 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd711b2-92d6-423e-a6b9-d89131d387f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc124936-9ea1-4373-90bb-eff4c17c8023]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd (non-flash)
Oct 23 20:47:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd (non-flash)
Oct 23 20:47:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d2c454c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b83ee-36af-4829-aa50-2be1f6772ad9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e3ea5a-6184-4dd2-aede-b972d2b3eadf]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[490011ed-9177-4ee9-bf6e-395994994ee8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9738e-cdb1-4473-97d3-3528b6da9a58]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac5618e-28c4-4a3a-8ccb-b507de256d3e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94ea5ed-452f-4398-893c-c6c14ef8a3c8]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260]
Oct 23 20:47:57 user nova-compute[74429]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd, portal: 172.16.0.220,3260] successful.
Oct 23 20:47:57 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d6607-3b4c-4c90-b5cc-c1748b5ced1f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== disconnect_volume: return (315ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Skipping network cache update for instance because it is being deleted. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 23 20:47:57 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.objects.instance [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'flavor' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-eda02f1d-fdc1-4908-aea6-9e1103864ad5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.627s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:47:58 user nova-compute[74429]: INFO nova.compute.manager [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Terminating instance
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-cff13ecc-6b16-4135-ab0a-f7ff7433a211 req-acefe1f7-a75c-4fc4-8217-0051c7465d33 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-vif-unplugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cff13ecc-6b16-4135-ab0a-f7ff7433a211 req-acefe1f7-a75c-4fc4-8217-0051c7465d33 service nova] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cff13ecc-6b16-4135-ab0a-f7ff7433a211 req-acefe1f7-a75c-4fc4-8217-0051c7465d33 service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-cff13ecc-6b16-4135-ab0a-f7ff7433a211 req-acefe1f7-a75c-4fc4-8217-0051c7465d33 service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-cff13ecc-6b16-4135-ab0a-f7ff7433a211 req-acefe1f7-a75c-4fc4-8217-0051c7465d33 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] No waiting events found dispatching network-vif-unplugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-cff13ecc-6b16-4135-ab0a-f7ff7433a211 req-acefe1f7-a75c-4fc4-8217-0051c7465d33 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-vif-unplugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Instance destroyed successfully.
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.objects.instance [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'resources' on Instance uuid 6f8fb335-f338-44fe-9050-40a759e77755 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1418549233',display_name='tempest-VolumesSnapshotTestJSON-instance-1418549233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1418549233',id=50,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAhY3NZYwBYwxb5z5kjc7GPyZ+vcziYZE/PtjksSnnq05tgFNfxxmbbhUhypyrDGMIbInpGj8MkmJNjSNXYfR7mcE0NKxDuBKBBJlPCe7Vsasn2QmBUzn3zIzSqif5W8A==',key_name='tempest-keypair-2034778977',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:44:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97f3b8ce3d5f40d3b1791dda4a477330',ramdisk_id='',reservation_id='r-u38770sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1478717835',owner_user_name='tempest-VolumesSnapshotTestJSON-1478717835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e602f25acd8439b896eeda675def9de',uuid=6f8fb335-f338-44fe-9050-40a759e77755,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converting VIF {"id": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "address": "fa:16:3e:5a:f4:01", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15450da-9d", "ovs_interfaceid": "d15450da-9d1d-4ffe-9b8f-908a278b7792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG os_vif [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd15450da-9d, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=603251c3-8fe7-42e3-bcc0-7b45e24be6df) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:58 user nova-compute[74429]: INFO os_vif [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=d15450da-9d1d-4ffe-9b8f-908a278b7792,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15450da-9d')
Oct 23 20:47:58 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:87e98c5a-acee-4df9-8370-8cded53a4ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roEGdUOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:47:58 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:47:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:47:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[59aab884-920d-4cb6-aceb-83f41edc0434]: Unexpected error while running command.
Oct 23 20:47:59 user nova-compute[74429]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:47:59 user nova-compute[74429]: Exit code: 21
Oct 23 20:47:59 user nova-compute[74429]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:47:59 user nova-compute[74429]: Stderr: '' {{(pid=85343) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 23 20:47:59 user nova-compute[74429]: Traceback (most recent call last):
Oct 23 20:47:59 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 23 20:47:59 user nova-compute[74429]:     ret = func(*f_args, **f_kwargs)
Oct 23 20:47:59 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 23 20:47:59 user nova-compute[74429]:     return func(*args, **kwargs)
Oct 23 20:47:59 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 23 20:47:59 user nova-compute[74429]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 23 20:47:59 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 23 20:47:59 user nova-compute[74429]:     return putils.execute(on_execute=on_execute,
Oct 23 20:47:59 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 23 20:47:59 user nova-compute[74429]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 23 20:47:59 user nova-compute[74429]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 20:47:59 user nova-compute[74429]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:47:59 user nova-compute[74429]: Exit code: 21
Oct 23 20:47:59 user nova-compute[74429]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:47:59 user nova-compute[74429]: Stderr: ''
Oct 23 20:47:59 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aab884-920d-4cb6-aceb-83f41edc0434]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 20:47:59 user nova-compute[74429]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:47:59 user nova-compute[74429]: Exit code: 21
Oct 23 20:47:59 user nova-compute[74429]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:47:59 user nova-compute[74429]: Stderr: ''
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 23 20:47:59 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi 
Oct 23 20:47:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74429) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== disconnect_volume: return (30ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:47:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Deleting instance files /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755_del
Oct 23 20:47:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Deletion of /opt/stack/data/nova/instances/6f8fb335-f338-44fe-9050-40a759e77755_del complete
Oct 23 20:47:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:47:59 user nova-compute[74429]: INFO nova.compute.manager [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 20:47:59 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:47:59 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:47:59 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Took 0.89 seconds to deallocate network for instance.
Oct 23 20:48:00 user nova-compute[74429]: WARNING nova.volume.cinder [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Attachment 64435ccc-f1f8-45ec-861b-39b61f8094f6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 64435ccc-f1f8-45ec-861b-39b61f8094f6. (HTTP 404) (Request-ID: req-47cc6b36-fbf3-4c6e-b484-8e73eadf4502)
Oct 23 20:48:00 user nova-compute[74429]: INFO nova.compute.manager [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Took 0.03 seconds to detach 1 volumes for instance.
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:48:00 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Deleted allocations for instance 6f8fb335-f338-44fe-9050-40a759e77755
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-9dcf5bdf-1317-4066-91fc-e00d02eeb5c5 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "6f8fb335-f338-44fe-9050-40a759e77755" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] Acquiring lock "6f8fb335-f338-44fe-9050-40a759e77755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] Lock "6f8fb335-f338-44fe-9050-40a759e77755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:48:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] No waiting events found dispatching network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:48:00 user nova-compute[74429]: WARNING nova.compute.manager [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received unexpected event network-vif-plugged-d15450da-9d1d-4ffe-9b8f-908a278b7792 for instance with vm_state deleted and task_state None.
Oct 23 20:48:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-8ac541bb-50e3-4dcf-b805-bbde6660774b req-5bee32f5-d07a-4b8f-91ef-0ff0116100b1 service nova] [instance: 6f8fb335-f338-44fe-9050-40a759e77755] Received event network-vif-deleted-d15450da-9d1d-4ffe-9b8f-908a278b7792 {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:48:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:48:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:48:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:48:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:48:08 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:18 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:21 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:48:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:48:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:48:23 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:33 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:38 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:43 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:48:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:48:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:48:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:48:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:51 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:48:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:48:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:48:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:48:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:48:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:48:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:48:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9140MB free_disk=25.255592346191406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:48:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:48:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:48:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:48:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:48:58 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:48:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:01 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:49:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:49:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:07 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:49:07 user nova-compute[74429]: INFO nova.compute.claims [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Claim successful on node user
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:49:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.policy [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e602f25acd8439b896eeda675def9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3b8ce3d5f40d3b1791dda4a477330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:49:08 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Creating image(s)
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "/opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "/opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.179s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.171s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk 1073741824" returned: 0 in 0.048s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Successfully created port: 4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Cannot resize image /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Ensure instance console log exists: /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Successfully updated port: 4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquired lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-changed-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.compute.manager [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Refreshing instance network info cache due to event network-changed-4087dde5-0238-46e1-99e2-fc8e5508d2cd. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] Acquiring lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Releasing lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Instance network_info: |[{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] Acquired lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.network.neutron [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Refreshing network info cache for port 4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Start _get_guest_xml network_info=[{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:49:09 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:49:09 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:49:09 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2035626845',display_name='tempest-VolumesSnapshotTestJSON-instance-2035626845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2035626845',id=51,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGnOUVKZI1/3UOf4q0eTFSuBhaP3nArjC145MS3gZYRXgRsIEf/UkyE8aNbeMT5ZU1ab8MgVJXkT8wNv4blnAgIb8gzuviYDI0oCJyaWydAqRdaUrL0hZht7YG6OeA6tg==',key_name='tempest-keypair-1397347835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97f3b8ce3d5f40d3b1791dda4a477330',ramdisk_id='',reservation_id='r-0c8rzfnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1478717835',owner_user_name='tempest-VolumesSnapshotTestJSON-1478717835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e602f25acd8439b896eeda675def9de',uuid=b3be48e9-c433-47dc-8d94-b185b799d0fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converting VIF {"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.objects.instance [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'pci_devices' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:49:10 user nova-compute[74429]:   <uuid>b3be48e9-c433-47dc-8d94-b185b799d0fc</uuid>
Oct 23 20:49:10 user nova-compute[74429]:   <name>instance-00000033</name>
Oct 23 20:49:10 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:49:10 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:49:10 user nova-compute[74429]:   <metadata>
Oct 23 20:49:10 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:49:10 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:49:10 user nova-compute[74429]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2035626845</nova:name>
Oct 23 20:49:10 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:49:09</nova:creationTime>
Oct 23 20:49:10 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:49:10 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:49:10 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:49:10 user nova-compute[74429]:       <nova:owner>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:user uuid="1e602f25acd8439b896eeda675def9de">tempest-VolumesSnapshotTestJSON-1478717835-project-member</nova:user>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:project uuid="97f3b8ce3d5f40d3b1791dda4a477330">tempest-VolumesSnapshotTestJSON-1478717835</nova:project>
Oct 23 20:49:10 user nova-compute[74429]:       </nova:owner>
Oct 23 20:49:10 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:49:10 user nova-compute[74429]:       <nova:ports>
Oct 23 20:49:10 user nova-compute[74429]:         <nova:port uuid="4087dde5-0238-46e1-99e2-fc8e5508d2cd">
Oct 23 20:49:10 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 20:49:10 user nova-compute[74429]:         </nova:port>
Oct 23 20:49:10 user nova-compute[74429]:       </nova:ports>
Oct 23 20:49:10 user nova-compute[74429]:     </nova:instance>
Oct 23 20:49:10 user nova-compute[74429]:   </metadata>
Oct 23 20:49:10 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:49:10 user nova-compute[74429]:     <system>
Oct 23 20:49:10 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:49:10 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:49:10 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:49:10 user nova-compute[74429]:       <entry name="serial">b3be48e9-c433-47dc-8d94-b185b799d0fc</entry>
Oct 23 20:49:10 user nova-compute[74429]:       <entry name="uuid">b3be48e9-c433-47dc-8d94-b185b799d0fc</entry>
Oct 23 20:49:10 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:49:10 user nova-compute[74429]:     </system>
Oct 23 20:49:10 user nova-compute[74429]:   </sysinfo>
Oct 23 20:49:10 user nova-compute[74429]:   <os>
Oct 23 20:49:10 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:49:10 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:49:10 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:49:10 user nova-compute[74429]:   </os>
Oct 23 20:49:10 user nova-compute[74429]:   <features>
Oct 23 20:49:10 user nova-compute[74429]:     <acpi/>
Oct 23 20:49:10 user nova-compute[74429]:     <apic/>
Oct 23 20:49:10 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:49:10 user nova-compute[74429]:   </features>
Oct 23 20:49:10 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:49:10 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:49:10 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:49:10 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:49:10 user nova-compute[74429]:   </clock>
Oct 23 20:49:10 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:49:10 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:49:10 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:49:10 user nova-compute[74429]:   </cpu>
Oct 23 20:49:10 user nova-compute[74429]:   <devices>
Oct 23 20:49:10 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:49:10 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:49:10 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk"/>
Oct 23 20:49:10 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:49:10 user nova-compute[74429]:     </disk>
Oct 23 20:49:10 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:49:10 user nova-compute[74429]:       <mac address="fa:16:3e:1c:b4:8a"/>
Oct 23 20:49:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:49:10 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:49:10 user nova-compute[74429]:       <target dev="tap4087dde5-02"/>
Oct 23 20:49:10 user nova-compute[74429]:     </interface>
Oct 23 20:49:10 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:49:10 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/console.log" append="off"/>
Oct 23 20:49:10 user nova-compute[74429]:     </serial>
Oct 23 20:49:10 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:49:10 user nova-compute[74429]:     <video>
Oct 23 20:49:10 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:49:10 user nova-compute[74429]:     </video>
Oct 23 20:49:10 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:49:10 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:49:10 user nova-compute[74429]:     </rng>
Oct 23 20:49:10 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:49:10 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:49:10 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:49:10 user nova-compute[74429]:     </memballoon>
Oct 23 20:49:10 user nova-compute[74429]:   </devices>
Oct 23 20:49:10 user nova-compute[74429]: </domain>
Oct 23 20:49:10 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2035626845',display_name='tempest-VolumesSnapshotTestJSON-instance-2035626845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2035626845',id=51,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGnOUVKZI1/3UOf4q0eTFSuBhaP3nArjC145MS3gZYRXgRsIEf/UkyE8aNbeMT5ZU1ab8MgVJXkT8wNv4blnAgIb8gzuviYDI0oCJyaWydAqRdaUrL0hZht7YG6OeA6tg==',key_name='tempest-keypair-1397347835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97f3b8ce3d5f40d3b1791dda4a477330',ramdisk_id='',reservation_id='r-0c8rzfnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1478717835',owner_user_name='tempest-VolumesSnapshotTestJSON-1478717835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e602f25acd8439b896eeda675def9de',uuid=b3be48e9-c433-47dc-8d94-b185b799d0fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converting VIF {"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG os_vif [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a7789d8-71bf-568a-8abf-c07fe9a34283', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4087dde5-02, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4087dde5-02, col_values=(('qos', UUID('259016be-8c81-47fe-9309-845cec3c2953')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4087dde5-02, col_values=(('external_ids', {'iface-id': '4087dde5-0238-46e1-99e2-fc8e5508d2cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b4:8a', 'vm-uuid': 'b3be48e9-c433-47dc-8d94-b185b799d0fc'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:10 user nova-compute[74429]: INFO os_vif [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02')
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No VIF found with MAC fa:16:3e:1c:b4:8a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updated VIF entry in instance network info cache for port 4087dde5-0238-46e1-99e2-fc8e5508d2cd. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG nova.network.neutron [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:49:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f1f3b80d-40b2-4efa-9778-e89d6947e98f req-dc408b4e-5db6-4b8f-afc9-de1ec69007c1 service nova] Releasing lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-4b4a51de-4ae3-4092-9ee8-36402e024f42 req-484df4a2-2264-4f4e-b7e8-85353d735cbd service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4b4a51de-4ae3-4092-9ee8-36402e024f42 req-484df4a2-2264-4f4e-b7e8-85353d735cbd service nova] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4b4a51de-4ae3-4092-9ee8-36402e024f42 req-484df4a2-2264-4f4e-b7e8-85353d735cbd service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-4b4a51de-4ae3-4092-9ee8-36402e024f42 req-484df4a2-2264-4f4e-b7e8-85353d735cbd service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG nova.compute.manager [req-4b4a51de-4ae3-4092-9ee8-36402e024f42 req-484df4a2-2264-4f4e-b7e8-85353d735cbd service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] No waiting events found dispatching network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:49:11 user nova-compute[74429]: WARNING nova.compute.manager [req-4b4a51de-4ae3-4092-9ee8-36402e024f42 req-484df4a2-2264-4f4e-b7e8-85353d735cbd service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received unexpected event network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd for instance with vm_state building and task_state spawning.
Oct 23 20:49:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:49:13 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Instance spawned successfully.
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-530368cf-9f01-40de-a82a-8a37c904715f req-e3e6ea21-c3e7-4890-a700-c714673da2cc service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-530368cf-9f01-40de-a82a-8a37c904715f req-e3e6ea21-c3e7-4890-a700-c714673da2cc service nova] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-530368cf-9f01-40de-a82a-8a37c904715f req-e3e6ea21-c3e7-4890-a700-c714673da2cc service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-530368cf-9f01-40de-a82a-8a37c904715f req-e3e6ea21-c3e7-4890-a700-c714673da2cc service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.compute.manager [req-530368cf-9f01-40de-a82a-8a37c904715f req-e3e6ea21-c3e7-4890-a700-c714673da2cc service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] No waiting events found dispatching network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:49:13 user nova-compute[74429]: WARNING nova.compute.manager [req-530368cf-9f01-40de-a82a-8a37c904715f req-e3e6ea21-c3e7-4890-a700-c714673da2cc service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received unexpected event network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd for instance with vm_state building and task_state spawning.
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:49:13 user nova-compute[74429]: INFO nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Took 5.49 seconds to spawn the instance on the hypervisor.
Oct 23 20:49:13 user nova-compute[74429]: DEBUG nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:49:13 user nova-compute[74429]: INFO nova.compute.manager [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Took 6.03 seconds to build instance.
Oct 23 20:49:13 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-e2cf1f46-f763-4b3a-87da-9c849a96c492 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.146s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:49:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:49:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:49:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:49:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:49:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:49:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:49:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:49:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:49:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:49:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:54 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:54 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:49:54 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:49:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:49:55 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.22586441040039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3be48e9-c433-47dc-8d94-b185b799d0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:49:55 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:49:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:49:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:50:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:50:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:50:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:50:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:50:01 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:50:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:25 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:50:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:50:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:50:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:50:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:50:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:50:56 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:50:56 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:50:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:50:57 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.225318908691406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3be48e9-c433-47dc-8d94-b185b799d0fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:50:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-changed-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:50:58 user nova-compute[74429]: DEBUG nova.compute.manager [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Refreshing instance network info cache due to event network-changed-4087dde5-0238-46e1-99e2-fc8e5508d2cd. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:50:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] Acquiring lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:50:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] Acquired lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:50:58 user nova-compute[74429]: DEBUG nova.network.neutron [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Refreshing network info cache for port 4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:50:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:50:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:50:59 user nova-compute[74429]: DEBUG nova.network.neutron [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updated VIF entry in instance network info cache for port 4087dde5-0238-46e1-99e2-fc8e5508d2cd. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:50:59 user nova-compute[74429]: DEBUG nova.network.neutron [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:50:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-f49203e9-0cd2-46ca-a041-d11d37575bfb req-53fa6eea-97c7-492a-b053-b0f7c45427eb service nova] Releasing lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG nova.objects.instance [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'flavor' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:51:00 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Ignoring supplied device name: /dev/vdb
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:51:00 user nova-compute[74429]: INFO nova.compute.manager [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Attaching volume b1ed9e01-a224-49ae-9a89-8e252152e580 to /dev/vdb
Oct 23 20:51:00 user nova-compute[74429]: DEBUG os_brick.utils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c57c5a-e977-4582-9a38-fb0ca078cd3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[99444cbb-c0c6-4cf2-85bd-15c2cb05945d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14e94f-2d43-41d0-956f-6364f4262b6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f3f3b-6a10-485f-abe2-3c7b5b4bd499]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:51:00 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:51:00 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf919e9e-71c2-4468-993d-43c0f6ac42b8]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG os_brick.utils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:51:00 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating existing volume attachment record: 297fb80f-6037-4a2d-a8cb-75fea94efefc {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:51:02 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:51:03 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:51:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:51:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:51:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:51:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMTLmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:51:16 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:51:16 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:51:16 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d10ac-9ca6-47da-9dbf-06d4e1072a27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:51:16 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e2771-88c4-4aab-9b12-c3b591927784]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580] added
Oct 23 20:51:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a4c67-010d-4286-93f9-0ea41e4a9125]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff46213-30e9-4f4d-920b-fd22ad58117e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKMTLmNs {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKMTLmNs" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9da320-1332-4577-9b16-61a294fc9e6d]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKMTLmNs'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[877667f1-e29e-49f8-b2b4-7d80673023b4]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[67be4647-1944-4795-8d65-601af19992f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:51:16 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:51:16 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:51:16 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:51:16 user nova-compute[74429]: 
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e65b180-5cd9-4c78-9914-1350fcf13c82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260]
Oct 23 20:51:16 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260] successful.
Oct 23 20:51:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9555a-0857-4144-9398-b69d4041b4e5]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb6011-5803-4d1a-acd2-e00a1179d81d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 (non-flash)
Oct 23 20:51:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 (non-flash)
Oct 23 20:51:16 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.227s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac9e211-c763-4885-b408-910e51710780]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:51:16 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMTLmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:51:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.258s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:51:17 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '26262303162373836', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:51:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262303162373836', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:51:17 user nova-compute[74429]: DEBUG nova.objects.instance [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'flavor' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:51:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:51:17 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:51:17 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:51:17 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:51:17 user nova-compute[74429]:   <serial>b1ed9e01-a224-49ae-9a89-8e252152e580</serial>
Oct 23 20:51:17 user nova-compute[74429]: </disk>
Oct 23 20:51:17 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:51:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:51:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:51:18 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] No VIF found with MAC fa:16:3e:1c:b4:8a, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:51:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-22321320-5e5e-4cea-8803-39b985a865ea tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.095s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:51:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:26 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:26 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:51:30 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:31 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:51:31 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:51:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:35 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:51:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:51:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:51:40 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:51:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:51:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:51:45 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:51:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:51:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:51:50 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:51:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:55 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:51:57 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:51:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:51:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:51:58 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:51:58 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:51:58 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74429) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 20:51:59 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:51:59 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=25.224075317382812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance b3be48e9-c433-47dc-8d94-b185b799d0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:51:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:00 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:52:02 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:52:03 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [{"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:52:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-b3be48e9-c433-47dc-8d94-b185b799d0fc" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:52:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:52:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:52:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:05 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:06 user nova-compute[74429]: INFO nova.compute.manager [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Detaching volume b1ed9e01-a224-49ae-9a89-8e252152e580
Oct 23 20:52:06 user nova-compute[74429]: INFO nova.virt.block_device [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Attempting to driver detach volume b1ed9e01-a224-49ae-9a89-8e252152e580 from mountpoint /dev/vdb
Oct 23 20:52:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Attempting to detach device vdb from instance b3be48e9-c433-47dc-8d94-b185b799d0fc from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:52:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:52:06 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:52:06 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:52:06 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:52:06 user nova-compute[74429]:   <serial>b1ed9e01-a224-49ae-9a89-8e252152e580</serial>
Oct 23 20:52:06 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:52:06 user nova-compute[74429]: </disk>
Oct 23 20:52:06 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:52:06 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully detached device vdb from instance b3be48e9-c433-47dc-8d94-b185b799d0fc from the persistent domain config.
Oct 23 20:52:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3be48e9-c433-47dc-8d94-b185b799d0fc from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:52:06 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:52:06 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:52:06 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:52:06 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:52:06 user nova-compute[74429]:   <serial>b1ed9e01-a224-49ae-9a89-8e252152e580</serial>
Oct 23 20:52:06 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:52:06 user nova-compute[74429]: </disk>
Oct 23 20:52:06 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:52:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:07 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:52:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:52:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:52:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:52:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:15 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:20 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:52:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:52:25 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:27 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b3be48e9-c433-47dc-8d94-b185b799d0fc is timed out.
Oct 23 20:52:27 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully detached device vdb from instance b3be48e9-c433-47dc-8d94-b185b799d0fc from the live domain config.
Oct 23 20:52:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMTLmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:52:27 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b47e3f-9036-4b3a-af80-decc238b1e4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:52:27 user nova-compute[74429]: No targets found.
Oct 23 20:52:27 user nova-compute[74429]: iSNS:
Oct 23 20:52:27 user nova-compute[74429]: No targets found.
Oct 23 20:52:27 user nova-compute[74429]: STATIC:
Oct 23 20:52:27 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580
Oct 23 20:52:27 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:52:27 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:52:27 user nova-compute[74429]: FIRMWARE:
Oct 23 20:52:27 user nova-compute[74429]: No targets found.
Oct 23 20:52:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:52:27 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:52:27 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc017d4f-6641-4364-89a4-ed4cfcacd8cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b24b35-3d89-47a1-84f3-b74bec75dc3e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 (non-flash)
Oct 23 20:52:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 (non-flash)
Oct 23 20:52:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d623ba7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85b10f7-1d1c-4d77-bffc-2169efd16215]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec88bae-d9e6-4980-8a52-dbf58fd41740]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47b846-d1f4-4191-aae5-a40a224024a1]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[82139ca1-4b48-4882-a67d-f02c4ab8f259]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9604776-5fd6-49be-93a5-0640eced8933]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b5a21-b819-439b-9fe3-0fad3c3ac50c]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260]
Oct 23 20:52:27 user nova-compute[74429]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580, portal: 172.16.0.220,3260] successful.
Oct 23 20:52:27 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a00f8-1930-451a-8b0f-f068fc226f53]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== disconnect_volume: return (280ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:52:27 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG nova.objects.instance [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'flavor' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-0809ed1a-494f-4178-9a26-8a0079e378eb tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.679s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.539s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:28 user nova-compute[74429]: INFO nova.compute.manager [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Terminating instance
Oct 23 20:52:28 user nova-compute[74429]: DEBUG nova.compute.manager [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-82138204-6487-45cf-8362-ed5b1de3558c req-5953e7c0-cc62-47f2-bc37-8808d0af1630 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-vif-unplugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-82138204-6487-45cf-8362-ed5b1de3558c req-5953e7c0-cc62-47f2-bc37-8808d0af1630 service nova] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-82138204-6487-45cf-8362-ed5b1de3558c req-5953e7c0-cc62-47f2-bc37-8808d0af1630 service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-82138204-6487-45cf-8362-ed5b1de3558c req-5953e7c0-cc62-47f2-bc37-8808d0af1630 service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-82138204-6487-45cf-8362-ed5b1de3558c req-5953e7c0-cc62-47f2-bc37-8808d0af1630 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] No waiting events found dispatching network-vif-unplugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:52:28 user nova-compute[74429]: DEBUG nova.compute.manager [req-82138204-6487-45cf-8362-ed5b1de3558c req-5953e7c0-cc62-47f2-bc37-8808d0af1630 service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-vif-unplugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Instance destroyed successfully.
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.objects.instance [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lazy-loading 'resources' on Instance uuid b3be48e9-c433-47dc-8d94-b185b799d0fc {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2035626845',display_name='tempest-VolumesSnapshotTestJSON-instance-2035626845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2035626845',id=51,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGnOUVKZI1/3UOf4q0eTFSuBhaP3nArjC145MS3gZYRXgRsIEf/UkyE8aNbeMT5ZU1ab8MgVJXkT8wNv4blnAgIb8gzuviYDI0oCJyaWydAqRdaUrL0hZht7YG6OeA6tg==',key_name='tempest-keypair-1397347835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97f3b8ce3d5f40d3b1791dda4a477330',ramdisk_id='',reservation_id='r-0c8rzfnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1478717835',owner_user_name='tempest-VolumesSnapshotTestJSON-1478717835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e602f25acd8439b896eeda675def9de',uuid=b3be48e9-c433-47dc-8d94-b185b799d0fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converting VIF {"id": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "address": "fa:16:3e:1c:b4:8a", "network": {"id": "ba925ece-d984-4aa2-9220-0fb67a55ee81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1145550779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97f3b8ce3d5f40d3b1791dda4a477330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4087dde5-02", "ovs_interfaceid": "4087dde5-0238-46e1-99e2-fc8e5508d2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_vif [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4087dde5-02, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=259016be-8c81-47fe-9309-845cec3c2953) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:29 user nova-compute[74429]: INFO os_vif [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b4:8a,bridge_name='br-int',has_traffic_filtering=True,id=4087dde5-0238-46e1-99e2-fc8e5508d2cd,network=Network(ba925ece-d984-4aa2-9220-0fb67a55ee81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4087dde5-02')
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ed9e01-a224-49ae-9a89-8e252152e580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMTLmNs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:52:29 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[03ebfe12-8e78-46c3-a6f0-97c6f254e08b]: Unexpected error while running command.
Oct 23 20:52:29 user nova-compute[74429]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:52:29 user nova-compute[74429]: Exit code: 21
Oct 23 20:52:29 user nova-compute[74429]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:52:29 user nova-compute[74429]: Stderr: '' {{(pid=85343) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 23 20:52:29 user nova-compute[74429]: Traceback (most recent call last):
Oct 23 20:52:29 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 23 20:52:29 user nova-compute[74429]:     ret = func(*f_args, **f_kwargs)
Oct 23 20:52:29 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 23 20:52:29 user nova-compute[74429]:     return func(*args, **kwargs)
Oct 23 20:52:29 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 23 20:52:29 user nova-compute[74429]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 23 20:52:29 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 23 20:52:29 user nova-compute[74429]:     return putils.execute(on_execute=on_execute,
Oct 23 20:52:29 user nova-compute[74429]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 23 20:52:29 user nova-compute[74429]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 23 20:52:29 user nova-compute[74429]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 20:52:29 user nova-compute[74429]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:52:29 user nova-compute[74429]: Exit code: 21
Oct 23 20:52:29 user nova-compute[74429]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:52:29 user nova-compute[74429]: Stderr: ''
Oct 23 20:52:29 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ebfe12-8e78-46c3-a6f0-97c6f254e08b]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 20:52:29 user nova-compute[74429]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:52:29 user nova-compute[74429]: Exit code: 21
Oct 23 20:52:29 user nova-compute[74429]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:52:29 user nova-compute[74429]: Stderr: ''
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 23 20:52:29 user nova-compute[74429]: ERROR os_brick.initiator.connectors.iscsi 
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74429) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] <== disconnect_volume: return (27ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:52:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Deleting instance files /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc_del
Oct 23 20:52:29 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Deletion of /opt/stack/data/nova/instances/b3be48e9-c433-47dc-8d94-b185b799d0fc_del complete
Oct 23 20:52:29 user nova-compute[74429]: INFO nova.compute.manager [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 20:52:29 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:52:29 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:52:30 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Took 0.72 seconds to deallocate network for instance.
Oct 23 20:52:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-6148324b-b20c-4002-8635-47db0a16f33b req-db91cf1c-9e8b-4846-8933-f305472f9c0d service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-vif-deleted-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:52:30 user nova-compute[74429]: WARNING nova.volume.cinder [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Attachment 297fb80f-6037-4a2d-a8cb-75fea94efefc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 297fb80f-6037-4a2d-a8cb-75fea94efefc. (HTTP 404) (Request-ID: req-9282bc15-2952-46e4-90ae-cf2a0649b94e)
Oct 23 20:52:30 user nova-compute[74429]: INFO nova.compute.manager [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Took 0.02 seconds to detach 1 volumes for instance.
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:30 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Deleted allocations for instance b3be48e9-c433-47dc-8d94-b185b799d0fc
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-06b1ff91-a206-4b79-8dfb-b377bb2e75d2 tempest-VolumesSnapshotTestJSON-1478717835 tempest-VolumesSnapshotTestJSON-1478717835-project-member] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.909s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-7c4d8597-6429-41e4-ae46-f383c47b6bf9 req-9843d08f-0160-4e1e-a63a-204140e9d5ab service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received event network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7c4d8597-6429-41e4-ae46-f383c47b6bf9 req-9843d08f-0160-4e1e-a63a-204140e9d5ab service nova] Acquiring lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7c4d8597-6429-41e4-ae46-f383c47b6bf9 req-9843d08f-0160-4e1e-a63a-204140e9d5ab service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-7c4d8597-6429-41e4-ae46-f383c47b6bf9 req-9843d08f-0160-4e1e-a63a-204140e9d5ab service nova] Lock "b3be48e9-c433-47dc-8d94-b185b799d0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:30 user nova-compute[74429]: DEBUG nova.compute.manager [req-7c4d8597-6429-41e4-ae46-f383c47b6bf9 req-9843d08f-0160-4e1e-a63a-204140e9d5ab service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] No waiting events found dispatching network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:52:30 user nova-compute[74429]: WARNING nova.compute.manager [req-7c4d8597-6429-41e4-ae46-f383c47b6bf9 req-9843d08f-0160-4e1e-a63a-204140e9d5ab service nova] [instance: b3be48e9-c433-47dc-8d94-b185b799d0fc] Received unexpected event network-vif-plugged-4087dde5-0238-46e1-99e2-fc8e5508d2cd for instance with vm_state deleted and task_state None.
Oct 23 20:52:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:52 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:52:59 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:53:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:53:00 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:53:00 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=25.250911712646484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:53:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:53:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:53:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:53:03 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:53:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:53:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:53:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:53:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:53:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:53:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:53:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:53:54 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:53:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:01 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:01 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:54:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:54:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:54:01 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:54:02 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:54:02 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:54:02 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.24966049194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:54:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:54:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:54:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:54:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:54:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:54:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:54:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:54:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:54:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:54:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:54:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:54:39 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:44 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:49 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:56 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Starting instance... {{(pid=74429) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74429) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 20:54:59 user nova-compute[74429]: INFO nova.compute.claims [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Claim successful on node user
Oct 23 20:54:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Start building networks asynchronously for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Allocating IP information in the background. {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.network.neutron [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] allocate_for_instance() {{(pid=74429) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 20:54:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Start building block device mappings for instance. {{(pid=74429) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.policy [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf4fbc18948e4dc8aaf91fc142853503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6a6bebe29b439b969325f8a6fd38ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74429) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Start spawning the instance on the hypervisor. {{(pid=74429) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Creating instance directory {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 20:54:59 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Creating image(s)
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "/opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "/opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:54:59 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "72b42852ed32ed225da6e714cfd9859b01201f9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk 1073741824 {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d,backing_fmt=raw /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk 1073741824" returned: 0 in 0.052s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "72b42852ed32ed225da6e714cfd9859b01201f9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Successfully created port: e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72b42852ed32ed225da6e714cfd9859b01201f9d --force-share --output=json" returned: 0 in 0.178s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk. size=1073741824 {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.virt.disk.api [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Cannot resize image /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk to a smaller size. {{(pid=74429) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Created local disks {{(pid=74429) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Ensure instance console log exists: /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/console.log {{(pid=74429) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Successfully updated port: e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.network.neutron [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Building network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-changed-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG nova.compute.manager [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Refreshing instance network info cache due to event network-changed-e6eef2dc-8fb0-4948-ad83-aae545d8609f. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:55:00 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Instance cache missing network info. {{(pid=74429) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.neutron [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Instance network_info: |[{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74429) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Refreshing network info cache for port e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Start _get_guest_xml network_info=[{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '2ada0c77-c749-4517-8f1f-639beb4e6c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 20:55:01 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:55:01 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CPU controller missing on host. {{(pid=74429) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.host [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CPU controller found on host. {{(pid=74429) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74429) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T19:55:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T19:55:35Z,direct_url=<?>,disk_format='qcow2',id=2ada0c77-c749-4517-8f1f-639beb4e6c0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ca447e7883e4fd9902144685af75bd5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T19:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Flavor limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Image limits 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Flavor pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Image pref 0:0:0 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Got 1 possible topologies {{(pid=74429) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.hardware [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74429) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1060140',id=52,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLsYTjCAfEZYu1feTTkc3jz5Ow2CqWkp7W+/gp1agZHCOcdpTgqjuqhAxElDKiLrEOEJaPex/H+Cgv/VU1XgIK4tg6G+8A5UWkXp0myvTDbHcLt6SMxRFbPH9YHmEN+Ag==',key_name='tempest-keypair-88140973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be6a6bebe29b439b969325f8a6fd38ec',ramdisk_id='',reservation_id='r-drjgrw97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1293443499',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf4fbc18948e4dc8aaf91fc142853503',uuid=f5dfe929-228e-4f55-883e-7a47114a7724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74429) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Converting VIF {"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.objects.instance [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lazy-loading 'pci_devices' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] End _get_guest_xml xml=<domain type="kvm">
Oct 23 20:55:01 user nova-compute[74429]:   <uuid>f5dfe929-228e-4f55-883e-7a47114a7724</uuid>
Oct 23 20:55:01 user nova-compute[74429]:   <name>instance-00000034</name>
Oct 23 20:55:01 user nova-compute[74429]:   <memory>524288</memory>
Oct 23 20:55:01 user nova-compute[74429]:   <vcpu>1</vcpu>
Oct 23 20:55:01 user nova-compute[74429]:   <metadata>
Oct 23 20:55:01 user nova-compute[74429]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 20:55:01 user nova-compute[74429]:       <nova:package version="0.0.0"/>
Oct 23 20:55:01 user nova-compute[74429]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312</nova:name>
Oct 23 20:55:01 user nova-compute[74429]:       <nova:creationTime>2023-10-23 20:55:01</nova:creationTime>
Oct 23 20:55:01 user nova-compute[74429]:       <nova:flavor name="m1.tiny">
Oct 23 20:55:01 user nova-compute[74429]:         <nova:memory>512</nova:memory>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:disk>1</nova:disk>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:swap>0</nova:swap>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:vcpus>1</nova:vcpus>
Oct 23 20:55:01 user nova-compute[74429]:       </nova:flavor>
Oct 23 20:55:01 user nova-compute[74429]:       <nova:owner>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:user uuid="cf4fbc18948e4dc8aaf91fc142853503">tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member</nova:user>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:project uuid="be6a6bebe29b439b969325f8a6fd38ec">tempest-TestServerVolumeAttachScenarioOldVersion-1293443499</nova:project>
Oct 23 20:55:01 user nova-compute[74429]:       </nova:owner>
Oct 23 20:55:01 user nova-compute[74429]:       <nova:root type="image" uuid="2ada0c77-c749-4517-8f1f-639beb4e6c0a"/>
Oct 23 20:55:01 user nova-compute[74429]:       <nova:ports>
Oct 23 20:55:01 user nova-compute[74429]:         <nova:port uuid="e6eef2dc-8fb0-4948-ad83-aae545d8609f">
Oct 23 20:55:01 user nova-compute[74429]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 20:55:01 user nova-compute[74429]:         </nova:port>
Oct 23 20:55:01 user nova-compute[74429]:       </nova:ports>
Oct 23 20:55:01 user nova-compute[74429]:     </nova:instance>
Oct 23 20:55:01 user nova-compute[74429]:   </metadata>
Oct 23 20:55:01 user nova-compute[74429]:   <sysinfo type="smbios">
Oct 23 20:55:01 user nova-compute[74429]:     <system>
Oct 23 20:55:01 user nova-compute[74429]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 20:55:01 user nova-compute[74429]:       <entry name="product">OpenStack Nova</entry>
Oct 23 20:55:01 user nova-compute[74429]:       <entry name="version">0.0.0</entry>
Oct 23 20:55:01 user nova-compute[74429]:       <entry name="serial">f5dfe929-228e-4f55-883e-7a47114a7724</entry>
Oct 23 20:55:01 user nova-compute[74429]:       <entry name="uuid">f5dfe929-228e-4f55-883e-7a47114a7724</entry>
Oct 23 20:55:01 user nova-compute[74429]:       <entry name="family">Virtual Machine</entry>
Oct 23 20:55:01 user nova-compute[74429]:     </system>
Oct 23 20:55:01 user nova-compute[74429]:   </sysinfo>
Oct 23 20:55:01 user nova-compute[74429]:   <os>
Oct 23 20:55:01 user nova-compute[74429]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 20:55:01 user nova-compute[74429]:     <boot dev="hd"/>
Oct 23 20:55:01 user nova-compute[74429]:     <smbios mode="sysinfo"/>
Oct 23 20:55:01 user nova-compute[74429]:   </os>
Oct 23 20:55:01 user nova-compute[74429]:   <features>
Oct 23 20:55:01 user nova-compute[74429]:     <acpi/>
Oct 23 20:55:01 user nova-compute[74429]:     <apic/>
Oct 23 20:55:01 user nova-compute[74429]:     <vmcoreinfo/>
Oct 23 20:55:01 user nova-compute[74429]:   </features>
Oct 23 20:55:01 user nova-compute[74429]:   <clock offset="utc">
Oct 23 20:55:01 user nova-compute[74429]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 20:55:01 user nova-compute[74429]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 20:55:01 user nova-compute[74429]:     <timer name="hpet" present="no"/>
Oct 23 20:55:01 user nova-compute[74429]:   </clock>
Oct 23 20:55:01 user nova-compute[74429]:   <cpu mode="custom" match="exact">
Oct 23 20:55:01 user nova-compute[74429]:     <model>Nehalem</model>
Oct 23 20:55:01 user nova-compute[74429]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 20:55:01 user nova-compute[74429]:   </cpu>
Oct 23 20:55:01 user nova-compute[74429]:   <devices>
Oct 23 20:55:01 user nova-compute[74429]:     <disk type="file" device="disk">
Oct 23 20:55:01 user nova-compute[74429]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 20:55:01 user nova-compute[74429]:       <source file="/opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk"/>
Oct 23 20:55:01 user nova-compute[74429]:       <target dev="vda" bus="virtio"/>
Oct 23 20:55:01 user nova-compute[74429]:     </disk>
Oct 23 20:55:01 user nova-compute[74429]:     <interface type="ethernet">
Oct 23 20:55:01 user nova-compute[74429]:       <mac address="fa:16:3e:a0:cf:ed"/>
Oct 23 20:55:01 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:55:01 user nova-compute[74429]:       <mtu size="1442"/>
Oct 23 20:55:01 user nova-compute[74429]:       <target dev="tape6eef2dc-8f"/>
Oct 23 20:55:01 user nova-compute[74429]:     </interface>
Oct 23 20:55:01 user nova-compute[74429]:     <serial type="pty">
Oct 23 20:55:01 user nova-compute[74429]:       <log file="/opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/console.log" append="off"/>
Oct 23 20:55:01 user nova-compute[74429]:     </serial>
Oct 23 20:55:01 user nova-compute[74429]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 20:55:01 user nova-compute[74429]:     <video>
Oct 23 20:55:01 user nova-compute[74429]:       <model type="virtio"/>
Oct 23 20:55:01 user nova-compute[74429]:     </video>
Oct 23 20:55:01 user nova-compute[74429]:     <rng model="virtio">
Oct 23 20:55:01 user nova-compute[74429]:       <backend model="random">/dev/urandom</backend>
Oct 23 20:55:01 user nova-compute[74429]:     </rng>
Oct 23 20:55:01 user nova-compute[74429]:     <controller type="usb" index="0" model="none"/>
Oct 23 20:55:01 user nova-compute[74429]:     <memballoon model="virtio">
Oct 23 20:55:01 user nova-compute[74429]:       <stats period="10"/>
Oct 23 20:55:01 user nova-compute[74429]:     </memballoon>
Oct 23 20:55:01 user nova-compute[74429]:   </devices>
Oct 23 20:55:01 user nova-compute[74429]: </domain>
Oct 23 20:55:01 user nova-compute[74429]:  {{(pid=74429) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1060140',id=52,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLsYTjCAfEZYu1feTTkc3jz5Ow2CqWkp7W+/gp1agZHCOcdpTgqjuqhAxElDKiLrEOEJaPex/H+Cgv/VU1XgIK4tg6G+8A5UWkXp0myvTDbHcLt6SMxRFbPH9YHmEN+Ag==',key_name='tempest-keypair-88140973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be6a6bebe29b439b969325f8a6fd38ec',ramdisk_id='',reservation_id='r-drjgrw97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1293443499',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T20:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf4fbc18948e4dc8aaf91fc142853503',uuid=f5dfe929-228e-4f55-883e-7a47114a7724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Converting VIF {"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG os_vif [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f') {{(pid=74429) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59a49c54-e098-5166-8193-e3c48c61678b', '_type': 'linux-noop'}}, row=False) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6eef2dc-8f, may_exist=True, interface_attrs={}) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6eef2dc-8f, col_values=(('qos', UUID('01bd7ed4-edfa-44f0-8119-13a9ef6422d9')),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6eef2dc-8f, col_values=(('external_ids', {'iface-id': 'e6eef2dc-8fb0-4948-ad83-aae545d8609f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:cf:ed', 'vm-uuid': 'f5dfe929-228e-4f55-883e-7a47114a7724'}),), if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:01 user nova-compute[74429]: INFO os_vif [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f')
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] No VIF found with MAC fa:16:3e:a0:cf:ed, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updated VIF entry in instance network info cache for port e6eef2dc-8fb0-4948-ad83-aae545d8609f. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:55:01 user nova-compute[74429]: DEBUG nova.network.neutron [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:55:02 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-fedcd8c7-86e6-4a54-a9eb-9e3a5789d509 req-b3e442b0-43fb-4e8c-8093-e4d3eafad8c0 service nova] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:55:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-42dc292e-3a55-4b08-80d4-369a8fd2ddfd req-c38d17b3-7eee-4f04-a6a2-66e0babec1c1 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-42dc292e-3a55-4b08-80d4-369a8fd2ddfd req-c38d17b3-7eee-4f04-a6a2-66e0babec1c1 service nova] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-42dc292e-3a55-4b08-80d4-369a8fd2ddfd req-c38d17b3-7eee-4f04-a6a2-66e0babec1c1 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-42dc292e-3a55-4b08-80d4-369a8fd2ddfd req-c38d17b3-7eee-4f04-a6a2-66e0babec1c1 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG nova.compute.manager [req-42dc292e-3a55-4b08-80d4-369a8fd2ddfd req-c38d17b3-7eee-4f04-a6a2-66e0babec1c1 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] No waiting events found dispatching network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:55:03 user nova-compute[74429]: WARNING nova.compute.manager [req-42dc292e-3a55-4b08-80d4-369a8fd2ddfd req-c38d17b3-7eee-4f04-a6a2-66e0babec1c1 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received unexpected event network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f for instance with vm_state building and task_state spawning.
Oct 23 20:55:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:55:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:04 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:55:04 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=25.246604919433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance f5dfe929-228e-4f55-883e-7a47114a7724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:04 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Instance event wait completed in 0 seconds for  {{(pid=74429) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Guest created on hypervisor {{(pid=74429) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 20:55:05 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Instance spawned successfully.
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Found default for hw_cdrom_bus of ide {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Found default for hw_disk_bus of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Found default for hw_input_bus of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Found default for hw_pointer_model of None {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Found default for hw_video_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Found default for hw_vif_model of virtio {{(pid=74429) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-e2d7c136-b5d6-4946-84ce-a25dda8eb324 req-88da0721-c645-467a-9834-53c6afdf1415 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e2d7c136-b5d6-4946-84ce-a25dda8eb324 req-88da0721-c645-467a-9834-53c6afdf1415 service nova] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e2d7c136-b5d6-4946-84ce-a25dda8eb324 req-88da0721-c645-467a-9834-53c6afdf1415 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e2d7c136-b5d6-4946-84ce-a25dda8eb324 req-88da0721-c645-467a-9834-53c6afdf1415 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.compute.manager [req-e2d7c136-b5d6-4946-84ce-a25dda8eb324 req-88da0721-c645-467a-9834-53c6afdf1415 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] No waiting events found dispatching network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:55:05 user nova-compute[74429]: WARNING nova.compute.manager [req-e2d7c136-b5d6-4946-84ce-a25dda8eb324 req-88da0721-c645-467a-9834-53c6afdf1415 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received unexpected event network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f for instance with vm_state building and task_state spawning.
Oct 23 20:55:05 user nova-compute[74429]: INFO nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Checking state {{(pid=74429) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 20:55:05 user nova-compute[74429]: INFO nova.compute.manager [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Took 5.81 seconds to build instance.
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-45334113-f961-4bc0-ba01-2a5cef49b143 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.913s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:55:05 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:55:06 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:55:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:55:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:55:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:55:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:14 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:19 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:29 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:34 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:40 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:55:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:55:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:55:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:55:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:55:58 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:56:03 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:56:04 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:56:04 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.217960357666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance f5dfe929-228e-4f55-883e-7a47114a7724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing inventories for resource provider a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating ProviderTree inventory for provider a94720e8-5668-448c-953f-7356c8921b17 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Updating inventory in ProviderTree for provider a94720e8-5668-448c-953f-7356c8921b17 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing aggregate associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, aggregates: None {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Refreshing trait associations for resource provider a94720e8-5668-448c-953f-7356c8921b17, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74429) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:56:04 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:56:06 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:56:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:56:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:56:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:56:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:56:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:18 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:18 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Triggering sync for uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 20:56:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:56:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:56:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:56:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:30 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:32 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:32 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74429) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 20:56:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:56:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:56:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:56:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:45 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:56:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Cleaning up deleted instances {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 20:56:45 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] There are 0 instances to clean {{(pid=74429) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 20:56:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:56:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:56:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:56:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:56:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-changed-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG nova.compute.manager [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Refreshing instance network info cache due to event network-changed-e6eef2dc-8fb0-4948-ad83-aae545d8609f. {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Refreshing network info cache for port e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updated VIF entry in instance network info cache for port e6eef2dc-8fb0-4948-ad83-aae545d8609f. {{(pid=74429) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG nova.network.neutron [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:56:50 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-b913f259-96ff-4a0a-8564-1fe106e39bf2 req-f6a2967a-0899-42d6-a4c4-a1eacd50a283 service nova] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:56:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:54 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:56:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:56:56 user nova-compute[74429]: DEBUG nova.objects.instance [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lazy-loading 'flavor' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:56:56 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:56:57 user nova-compute[74429]: INFO nova.compute.manager [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Attaching volume 42a48e5a-0de2-4625-a457-dbc19b30860f to /dev/vdb
Oct 23 20:56:57 user nova-compute[74429]: DEBUG os_brick.utils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb07d9a-56e9-45d8-9362-6e3ff3bb3157]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:da43702393f8\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c8b343-1b50-4a8b-8fd7-630d58373a8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c998fe93-0f86-4cab-9783-798ad97fa810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[f510003e-b853-476b-bb55-8f279ebce4a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Running cmd (subprocess): nvme version {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] 'nvme version' failed. Not Retrying. {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.nvmeof [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] nvme not present on system {{(pid=74429) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 20:56:57 user nova-compute[74429]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 20:56:57 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f5f31a-c247-4067-bdc6-896118e2b929]: (4, '') {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74429) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.lightos [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] LIGHTOS: no hostnqn found. {{(pid=74429) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG os_brick.utils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:da43702393f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:56:57 user nova-compute[74429]: DEBUG nova.virt.block_device [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating existing volume attachment record: 92d94600-ffe1-43a9-b53d-827078522b71 {{(pid=74429) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 20:56:59 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:56:59 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:02 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:03 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:05 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:57:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:57:05 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:57:05 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:57:05 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:06 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:57:06 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.21707534790039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance f5dfe929-228e-4f55-883e-7a47114a7724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:57:06 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:57:07 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:57:08 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:57:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:57:08 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:57:08 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:09 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:10 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Calling os-brick to attach iSCSI Volume {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZEdRMNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:57:13 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:57:13 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:57:13 user nova-compute[74429]: INFO os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[df69c3bc-03d1-4fcf-a209-9368b548b505]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 20:57:13 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --interface default --op new {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c840bcee-442e-4197-9f7b-41adb67e88bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f] added\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f] added
Oct 23 20:57:13 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4d2ce4-d1b6-42dc-a743-cb1fd0514e5c]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5561ab1e-d0bf-4f0e-a207-4a611542ccf8]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZEdRMNO {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZEdRMNO" returned: 0 in 0.020s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d05cd0-30a6-48fe-9c1e-f6b7cfcfd819]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nZEdRMNO'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad11f9-c1a7-4456-b918-27477bac62f6]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac33287f-8b19-49c4-964f-c8e5dd516d9c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:57:13 user nova-compute[74429]:  {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 20:57:13 user nova-compute[74429]:  {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:57:13 user nova-compute[74429]: WARNING os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 20:57:13 user nova-compute[74429]: 
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --login {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f10c19a-1a4c-410d-a961-a17123c50eea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260]
Oct 23 20:57:13 user nova-compute[74429]: Login to [iface: default, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260] successful.
Oct 23 20:57:13 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6cdd5c-dd8b-4910-9d61-942b5ecfcc4e]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec0b0c-15b9-42bf-9f64-2362564a3ccd]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f (non-flash)
Oct 23 20:57:13 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f (non-flash)
Oct 23 20:57:13 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Connected to 172.16.0.220:3260 {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74429) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74429) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ddbf8f-b8b4-4128-a7ac-8235a811d015]: (4, ('- - 0', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74429) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZEdRMNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74429) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 20:57:13 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23037323034333464', 'path': '/dev/sdb'} {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037323034333464', 'path': '/dev/sdb'} {{(pid=74429) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG nova.objects.instance [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lazy-loading 'flavor' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 20:57:14 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:57:14 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:57:14 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:57:14 user nova-compute[74429]:   <serial>42a48e5a-0de2-4625-a457-dbc19b30860f</serial>
Oct 23 20:57:14 user nova-compute[74429]: </disk>
Oct 23 20:57:14 user nova-compute[74429]:  {{(pid=74429) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] No BDM found with device name vda, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74429) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] No VIF found with MAC fa:16:3e:a0:cf:ed, not building metadata {{(pid=74429) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 20:57:14 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-765267b3-0d1e-43a4-a762-552f01bd1368 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.962s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:57:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:57:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:57:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:57:16 user nova-compute[74429]: INFO nova.compute.manager [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Detaching volume 42a48e5a-0de2-4625-a457-dbc19b30860f
Oct 23 20:57:16 user nova-compute[74429]: INFO nova.virt.block_device [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Attempting to driver detach volume 42a48e5a-0de2-4625-a457-dbc19b30860f from mountpoint /dev/vdb
Oct 23 20:57:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Attempting to detach device vdb from instance f5dfe929-228e-4f55-883e-7a47114a7724 from the persistent domain config. {{(pid=74429) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 20:57:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:57:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:57:16 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:57:16 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:57:16 user nova-compute[74429]:   <serial>42a48e5a-0de2-4625-a457-dbc19b30860f</serial>
Oct 23 20:57:16 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:57:16 user nova-compute[74429]: </disk>
Oct 23 20:57:16 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:57:16 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Successfully detached device vdb from instance f5dfe929-228e-4f55-883e-7a47114a7724 from the persistent domain config.
Oct 23 20:57:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5dfe929-228e-4f55-883e-7a47114a7724 from the live domain config. {{(pid=74429) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 20:57:16 user nova-compute[74429]: DEBUG nova.virt.libvirt.guest [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 20:57:16 user nova-compute[74429]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 20:57:16 user nova-compute[74429]:   <source dev="/dev/sdb"/>
Oct 23 20:57:16 user nova-compute[74429]:   <target dev="vdb" bus="virtio"/>
Oct 23 20:57:16 user nova-compute[74429]:   <serial>42a48e5a-0de2-4625-a457-dbc19b30860f</serial>
Oct 23 20:57:16 user nova-compute[74429]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 20:57:16 user nova-compute[74429]: </disk>
Oct 23 20:57:16 user nova-compute[74429]:  {{(pid=74429) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 20:57:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.driver [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 20:57:21 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:57:24 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:26 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:31 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:36 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:37 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5dfe929-228e-4f55-883e-7a47114a7724 is timed out.
Oct 23 20:57:37 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Successfully detached device vdb from instance f5dfe929-228e-4f55-883e-7a47114a7724 from the live domain config.
Oct 23 20:57:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] calling os-brick to detach iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7d505780a0>, {'target_iqn': 'iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZEdRMNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 20:57:37 user nova-compute[74429]: WARNING os_brick.initiator.connectors.base [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5bfe39-936d-4075-a1b5-05d34c9d0c4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 20:57:37 user nova-compute[74429]: No targets found.
Oct 23 20:57:37 user nova-compute[74429]: iSNS:
Oct 23 20:57:37 user nova-compute[74429]: No targets found.
Oct 23 20:57:37 user nova-compute[74429]: STATIC:
Oct 23 20:57:37 user nova-compute[74429]: Target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f
Oct 23 20:57:37 user nova-compute[74429]:         Portal: 172.16.0.220:3260,-1
Oct 23 20:57:37 user nova-compute[74429]:                 Iface Name: default
Oct 23 20:57:37 user nova-compute[74429]: FIRMWARE:
Oct 23 20:57:37 user nova-compute[74429]: No targets found.
Oct 23 20:57:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 20:57:37 user nova-compute[74429]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 20:57:37 user nova-compute[74429]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74429) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f', 0)] {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b1d6d5-93de-45aa-a664-ad00351836f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c3e4d-51c0-4591-b2a8-7c89ae2c8982]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f (non-flash)\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f (non-flash)
Oct 23 20:57:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f (non-flash)
Oct 23 20:57:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7d50670670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f'): ({'sdb'}, set())}) {{(pid=74429) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Removing single pathed devices sdb {{(pid=74429) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[819057de-df1a-4168-a499-3a0a63b3e1f5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aca6e4-bc0d-4672-9948-038608248c76]: (4, ('ok\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Flushing IO for device /dev/sdb {{(pid=74429) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d74735-b782-4390-9369-d3057dc70d18]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74429) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32164a5-6ddc-497f-8d40-85ec0aee57e0]: (4, ('1', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.linuxscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] SCSI volumes sdb have been removed. {{(pid=74429) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f')] {{(pid=74429) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e61c080-8986-421a-bfbf-7a99fc9f6b15]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --logout {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ca32e-70d5-4474-b760-f30d62bc222f]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260]
Oct 23 20:57:37 user nova-compute[74429]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f, portal: 172.16.0.220,3260] successful.
Oct 23 20:57:37 user nova-compute[74429]:  stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op delete {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42a48e5a-0de2-4625-a457-dbc19b30860f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a83c74e-644b-4d9f-906e-4d9cf4dc949f]: (4, ('', '')) {{(pid=85343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74429) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.base [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] <== disconnect_volume: return (308ms) None {{(pid=74429) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 20:57:37 user nova-compute[74429]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Disconnected iSCSI Volume {{(pid=74429) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 20:57:38 user nova-compute[74429]: DEBUG nova.objects.instance [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lazy-loading 'flavor' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:57:38 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-f4d4d7ea-158c-46c2-9951-46a9046882ac tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.867s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:57:41 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:46 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:57:51 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:57:56 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:01 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:58:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:58:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:58:06 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:58:07 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.processutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74429) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 20:58:08 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:58:08 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.20830535888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Instance f5dfe929-228e-4f55-883e-7a47114a7724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74429) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:58:08 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquired lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Forcefully refreshing network info cache for instance {{(pid=74429) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 20:58:09 user nova-compute[74429]: DEBUG nova.objects.instance [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lazy-loading 'info_cache' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:58:10 user nova-compute[74429]: DEBUG nova.network.neutron [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [{"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:58:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Releasing lock "refresh_cache-f5dfe929-228e-4f55-883e-7a47114a7724" {{(pid=74429) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 20:58:10 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updated the network info_cache for instance {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 20:58:11 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:58:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:15 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:16 user nova-compute[74429]: INFO nova.compute.manager [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Terminating instance
Oct 23 20:58:16 user nova-compute[74429]: DEBUG nova.compute.manager [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Start destroying the instance on the hypervisor. {{(pid=74429) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:16 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-5d155c8d-f367-437d-ae36-59796a63906c req-9548c05d-4f3e-470c-a0f8-661b9de28444 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-vif-unplugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5d155c8d-f367-437d-ae36-59796a63906c req-9548c05d-4f3e-470c-a0f8-661b9de28444 service nova] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5d155c8d-f367-437d-ae36-59796a63906c req-9548c05d-4f3e-470c-a0f8-661b9de28444 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-5d155c8d-f367-437d-ae36-59796a63906c req-9548c05d-4f3e-470c-a0f8-661b9de28444 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-5d155c8d-f367-437d-ae36-59796a63906c req-9548c05d-4f3e-470c-a0f8-661b9de28444 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] No waiting events found dispatching network-vif-unplugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.compute.manager [req-5d155c8d-f367-437d-ae36-59796a63906c req-9548c05d-4f3e-470c-a0f8-661b9de28444 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-vif-unplugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f for instance with task_state deleting. {{(pid=74429) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [-] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Instance destroyed successfully.
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.objects.instance [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lazy-loading 'resources' on Instance uuid f5dfe929-228e-4f55-883e-7a47114a7724 {{(pid=74429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.virt.libvirt.vif [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T20:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1060140312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1060140',id=52,image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLsYTjCAfEZYu1feTTkc3jz5Ow2CqWkp7W+/gp1agZHCOcdpTgqjuqhAxElDKiLrEOEJaPex/H+Cgv/VU1XgIK4tg6G+8A5UWkXp0myvTDbHcLt6SMxRFbPH9YHmEN+Ag==',key_name='tempest-keypair-88140973',keypairs=<?>,launch_index=0,launched_at=2023-10-23T20:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be6a6bebe29b439b969325f8a6fd38ec',ramdisk_id='',reservation_id='r-drjgrw97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ada0c77-c749-4517-8f1f-639beb4e6c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1293443499',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T20:55:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf4fbc18948e4dc8aaf91fc142853503',uuid=f5dfe929-228e-4f55-883e-7a47114a7724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Converting VIF {"id": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "address": "fa:16:3e:a0:cf:ed", "network": {"id": "2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1830401539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be6a6bebe29b439b969325f8a6fd38ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6eef2dc-8f", "ovs_interfaceid": "e6eef2dc-8fb0-4948-ad83-aae545d8609f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.network.os_vif_util [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f') {{(pid=74429) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG os_vif [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f') {{(pid=74429) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6eef2dc-8f, bridge=br-int, if_exists=True) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01bd7ed4-edfa-44f0-8119-13a9ef6422d9) {{(pid=74429) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:17 user nova-compute[74429]: INFO os_vif [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:cf:ed,bridge_name='br-int',has_traffic_filtering=True,id=e6eef2dc-8fb0-4948-ad83-aae545d8609f,network=Network(2711d2e4-68fb-4d5d-a0c6-68e8bb1f2427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6eef2dc-8f')
Oct 23 20:58:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Deleting instance files /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724_del
Oct 23 20:58:17 user nova-compute[74429]: INFO nova.virt.libvirt.driver [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Deletion of /opt/stack/data/nova/instances/f5dfe929-228e-4f55-883e-7a47114a7724_del complete
Oct 23 20:58:17 user nova-compute[74429]: INFO nova.compute.manager [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 20:58:17 user nova-compute[74429]: DEBUG oslo.service.loopingcall [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74429) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.compute.manager [-] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Deallocating network for instance {{(pid=74429) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 20:58:17 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] deallocate_for_instance() {{(pid=74429) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 20:58:18 user nova-compute[74429]: DEBUG nova.network.neutron [-] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Updating instance_info_cache with network_info: [] {{(pid=74429) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 20:58:18 user nova-compute[74429]: INFO nova.compute.manager [-] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Took 0.61 seconds to deallocate network for instance.
Oct 23 20:58:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:18 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:58:18 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:58:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:18 user nova-compute[74429]: INFO nova.scheduler.client.report [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Deleted allocations for instance f5dfe929-228e-4f55-883e-7a47114a7724
Oct 23 20:58:18 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-1c1a76f1-f1e4-4c9a-9528-ee1a9d16f346 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499 tempest-TestServerVolumeAttachScenarioOldVersion-1293443499-project-member] Lock "f5dfe929-228e-4f55-883e-7a47114a7724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:58:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] Acquiring lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:58:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:58:19 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] Lock "f5dfe929-228e-4f55-883e-7a47114a7724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:58:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] No waiting events found dispatching network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 20:58:19 user nova-compute[74429]: WARNING nova.compute.manager [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received unexpected event network-vif-plugged-e6eef2dc-8fb0-4948-ad83-aae545d8609f for instance with vm_state deleted and task_state None.
Oct 23 20:58:19 user nova-compute[74429]: DEBUG nova.compute.manager [req-e865a265-004d-4d7c-808b-1d435a06b4a1 req-f2173b2d-cfaa-49a8-85b0-26d72accced7 service nova] [instance: f5dfe929-228e-4f55-883e-7a47114a7724] Received event network-vif-deleted-e6eef2dc-8fb0-4948-ad83-aae545d8609f {{(pid=74429) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 20:58:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:58:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:58:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:58:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:33 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:58:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:58:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:58:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:58:42 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:47 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:58:52 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:58:57 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:59:00 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:59:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74429) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 20:59:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:59:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74429) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 20:59:02 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:04 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:06 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:59:07 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:07 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:09 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:59:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:59:09 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:59:09 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74429) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:59:10 user nova-compute[74429]: WARNING nova.virt.libvirt.driver [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 20:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Hypervisor/Node resource view: name=user free_ram=9115MB free_disk=25.23525619506836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74429) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74429) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG nova.compute.provider_tree [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed in ProviderTree for provider: a94720e8-5668-448c-953f-7356c8921b17 {{(pid=74429) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG nova.scheduler.client.report [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Inventory has not changed for provider a94720e8-5668-448c-953f-7356c8921b17 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74429) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG nova.compute.resource_tracker [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Compute_service record updated for user:user {{(pid=74429) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 20:59:10 user nova-compute[74429]: DEBUG oslo_concurrency.lockutils [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74429) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 20:59:11 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Starting heal instance info cache {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 20:59:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Rebuilding the list of instances to heal {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 20:59:11 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Didn't find any instances for network info cache update. {{(pid=74429) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 20:59:12 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:12 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:12 user nova-compute[74429]: DEBUG nova.compute.manager [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74429) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 20:59:13 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:16 user nova-compute[74429]: DEBUG oslo_service.periodic_task [None req-390a994d-062d-4acd-8c2b-52e7edafdef3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74429) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 20:59:17 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:22 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:59:27 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 20:59:32 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 20:59:37 user nova-compute[74429]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74429) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}